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ABSTRACT 

The objectives of/this project were four-fold: (1) to 
identify new or improved procedures for assisting schools in 
conducting program evaluation, (2) to test and demonstrate evaluation 
procedures to determine whether the secondary and post-secondary 
programs of vocation ail education in Central Kentucky are fulfilling 
the stated objectives, (3) to develop state and local leadership 
competencies needed for evaluating programs of vocational education, 
and (4) to help local personnel beccmie proficient in identifying 
needs and in using correct prescriptive techniques for assessing 
deficiencies. Though the attention was focused on local leadership 
and evaluative problems, it was the intent that the procedures 
developed would be used by all regions of the state. The systematic 
steps for the operaticm of the Vocational Education Evaluation 
Project (VEEP) were the following: (1) Needs assessment, (2) 
Philosophy development, (3) Formulation of objectives (4) Statement 
of criterion, (5) Data collection, (6) Data analysis, (7) Formulation 
of recommendations, and (8) Decision-making. Workshops, conferences 
and- progress review meetings were held for participants. Findings, 
recommendations, and conclusions are included. (Author/SN) 
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PREFACE 

The Central r.entuck/ Vocational Education Evaluation Project (VEEP) 
was a pilot effort funded by the Kentucky State Department of Education 
through the Bureau of Vocational Education. The project was administered 
by the Supporting Services Unit with specific responsibility lod^^ed with 
the Research Coordinating Unit for Vocational Education and the State ^ 
Program Evaluation Unit. 

This is a final report on the project. It summarizes all the 
activities carried out and includes the outcomes of the evaluation effort. 
Since VEEP was a pilot project, special attention should be given to the 
conclusions reached and the recommendations offered. It is hoped that they 
will have implications for ott?.r vocational education evaluation efforts. 
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CHAPTER I 

INTRODUCTION 
Background of the PRojprT 



have ^eauSdlhat" ^'^^'''1' ^'^^ educ'JonaJ-prograi 

thev llllZt t rigorous and continuous evaluation 

this emphasis on s:i^ exLnation. " ^"'^ 

a «JJ ;'°"ti°nal education, the concern for evaluation has received 
a great deal of impetus from the 1963 Report of the President's Panel of 
Consultants on Vocational Education. This report had a tremendous effect 

?ocaJion:rL°"'M''"r''°" °' '''' (P.l/88-210) and the subsequent 
Vocational Education Amendments of 1968 (P.L. 90-576). "equenc 

activIt2s^°"ThMQAf a" f ^ "^'^"^'^^'^ evaluation 
^n^Mf Amendments to the 1963 Vocational Education Act 

?^n5. r''"'" "'^'^ ^'"'^^ receiving Federal vocational education ' 

funds to submit an annual evaluation report to the U.S. Commissioner 
of education and the National Advisory Council, This rep.?? must colJtain: 
(1) the results of the evaluation of programs, services/and actlvuJes 
carried out under the State Plan for Vocational Education. (The eva" 
uatlons must examine the effectiveness of these programs, services and 
activities in meeting the program objectives set up'unde^ the long-range 
and annual program plans) and (2) such recommended changes as are deemed 

Jhe'r::^'' ^.'^^ State Advisory Council for Vocational Education bas^S on 
the results of the evaluations. uaocu on 

v« ^•" "'"Pi^^"'=? "i'^h the Federal legislation, the State Plan for 
Vocational Education requires local education agencies to submit long- 
range and annual program plans and to provide the results of evaluation- 
efforts as evidence of needs and accomplishments. 

would^Kr/^ "^''^ no requirements for evaluation, vocational educators 

would be less than professional if they did not conduct evaluation 
activities. A desire to learn what educational approaches are best and 
Why and a desire to examine the learning process areUannarks of the 
professional; and in many cases, evaluation activities and these research 
activities are closely related. There is a need for the type of evalua- 
tion activities which can answer some of our basic questions. 
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In addition to legal and scientific needs for evalxiation, there - 
is a iQoral need* We have a treoemdous responsibility to society* We must 
provide students 7ith job skills j knowledge, and attitudes v*"lch will 
make them employable. We have an obligation to justify the large ex- 
penditures of time, moriey, and human effort used to carry out this re- 
sponsibility* We also have a_moral obligation to demonstrate that we 
are doing the best job of which we- are capable in our attempt to serve 
the needs of all citizens in light of their interests', needs, and abili- 
ties. It is only through evaluation activities that we can legally, 
morally, and scientifically plan for future programs, services, and 
activities. 

Today, it is not a question of whether we shall evaluate, but, "How 
we shall evaluate." It has been indicated that program evaluation is the 
basis for sound decision-making. Evaluation is not something done 
periodically as an added part of the duties of vocational educators. 
It must be a vital part of the educational process and it must be 
continuous. 

If evaluation is a vital, continual undertaking, then it must be 
carried out systematically. It must be tied to the other elements of 
the vocational education endeavor. It must provide informatio.n to all 
parts of the system so that changes can be made where needed. It was 
this concern over the need for systematic evaluation that led to the 
development of VEEP. 

Several nation-wide and state evaluation studies provided a back- 
ground for this project. These Include the National Evaluation of Voca- 
tional Industrial Education by the American Institute for Research, (9), 
the study of community college technical education (6) , the Model to 
Evaluate State Programs of Vocational Education (8), Project Vo-Ed (4), 
and th Joint State-O.E. Task Force on Evaluation (5). 

Three other studies in particular influenced the approach utilized 
in V2EP. These Federally-supported research projects were carried out 
at Michigan State University under the leadership of Dr. Harold M. Byram. 
The Michigan Project on Evaluation of Local Programs of Vocational 
Education and a Developmental Vocational Education Research and Teacher 
Education Program based on Clinical School Concept (1) were the two 
projects that led to the model used in the VEEP project. The model was 
tested again in the Multi-State Project on Local Program Evaluation 
(2) which was coordinated at Michigan State University. VEEF, chough 
not a multi-state project, had similar purposes and approaches. 

The two projects Dr. Byram coordinated were conducted to test and 
demonstrate a system for local evaluations of vocational education 
programs. The results of the projects led to the formulation by 
Dr. Byram and his associates of a manual for use by administrators, 
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teachers, and citizens. The eaphasic of the manual entitled 
3taTcMENT of the PpnRi PM 

for q^^rPr*^ withir. the Bureau of Vocatiom.l Education a provision 

J% Evaluation in keeping with legislative aaSdaJes. In 

teras rf fomal organization for coordinated locsl, regional and state 
evaluation efforts, however, no organizational relitioashJps '.x^st: " 

fnr^.Tl °f 'h"* « lack Of formal organ.lzatiou. but there were no 

formal evaluation procedures. Evaluation in a systematic way was not 
being successfully carried out. Those responsible for operatinrvocat J onal 
education programs, especially at the local level, did not possL the 

iziiz ,^"a^:s^:^^- ~- - e"fL^ti::^^^^ionai 

^PPdp?'^ ^r^^? ^'t^'t^ vocational educators was two-fol.. Thoy 
needed to know both how to organize a successful evaluation effort and ■ 
what procedures and techniques could be used for sue cess lunvev;iuacJn. 
local, regional, and state programs. The problem was:. "How^arschco? 

or'adont /I "^"'^"^ organized. 'train their personnel /dlveL 

or adopt evaluation procedures arid techniques, and implecen" a locallv 
admlnistered-state assisted evaluation effort?" P^^^*"- ^ iocal.Ly 

Objectives 

follovJS? objectives of VEEP, as stated in the original proposal, were, as 

1. To Identify new or inprovad proc^^dures for assisting 
schools In conducting program evaluation. 

2. To test and demonstrate evaluation procedures to 
determine whether the secondary and post-secondary 
programs of vocational education in Central Kentucky 
are fulfilling the stated objectives. 

3. To develop state and local leadershin competencies 
needed for evaluating programs of vocational education. 



4. To enable personnel in the local and regional schools 
to be more proficient in: 

a) identifying community and individual needs, 

b) writing a vocational education philosophy, 

c) writing performance objectives, 

d) identifying the essential elements of a 
product-oriented program evaluation effort, 

e) writing a product oriented evaluation plan for 
their local and/or regional program of vocational 
education, 

f) identifying the steps in organizing and using 
a citizens advisory committee, 

g) developing and administering follow-up 
instruments demonstrated to be successful ' 
by research, 

h) analyzing data and developing recommendations 
based upon the analysis of data, and 

i) identifying successful procedur.^s and 
techniques for dissiminating and implementing 
evaluation findings. 

Project Focal Points 



The project focused on several points of emphasis. The first 
of these was local involvement. The project stressed the involvement 
of local people because they are ultimately responsible for implementing 
program changes. Importance was placed on self-evaluation by local 
citizens, students, and local school professional personnel concerned 
with the program rather than evaluation by outside experts. Local 
people responsible for and affected by vocational programs do make 
appraisals of these programs regardless of the information or lack of 
information they possess for making such evaluations. 

The project emaphsized the importance of local objectives. 
Objectives were formulated and/or revised by the local citizens, local 
school personnel, and students. Objectives were stated so as to clearly 
indicate what the person completing the program was expected to be able 



5 



schools ^ith other^ra^l^^^^^^^^ ^S^h^^Sf 

wJlon^n^ WW ^ "^^^ performing the evaluation 

runction know what the program was striving to accomplish. 

P^ject concentrated on product-oriented evaluation. The 
emphasis was on effectiveness rather than abstract standards of excellence 
This product or output orientation contrasted with most accredits??^ 

'^^'^^ ^-P^--^'^ process eleme:?ror"ayf ^d 

ToTlLTflTy,°"T'''.T P'^*^^' °" attainmenrorthe behav- 

iJLrrJi ^ objectives. B^ed on the findings of the eva'uation 

tliZr, anticipated that certain process element or inputs 6f rte 

educational program would need to be altered. ^ 

.J^l project was centered on vocational education, and the focus was 
All parts of the curriculum having vocational objectives were considered. 

7„.«7^'S^^? focused on local problems of evaluation and on 
local initiative and leadership in solving these problems as they were 
supplemented by effective specialized consultant service. Important 
llZT t «-«l"*tion project included strong administSi^e 

S?Ser"n;o'rr'^"^ ^^''"^^ leadership, use of staff and citizen com- 
mittees, provision of time for faculty and project leaders to perform 
evaluation tasks, and effective consultant services. Perform 

nrniJil "^^ift intention that the procedures developed in this 

project would be used by all regions of the State. The compiiation 
of the local and regional evaluations would comprise a major element in 
the evaluation of the State program of vocational education. 

Planning and Evaluation siystpm 

The planning and evaluation system utilized in VEEP is graphically 
illustrated on the following page: spy 
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The system specifies the relationships which should exist for the 
purposes of planning and evaluation. Administrative connnitmant is an 
essential first-step. Organizing to do the job logically follows. An 
evaluation plan then must be developed and finally the implementation 
phase consisting of several components must be executed* 

Implementation must begin with an assessment of the present 
situation in order to identify needs. An overall philosophy of vocational 
education must be developed and agreed upon. Measurable, behaviorally 
stated objections must be developed. Criterion questions must be stated 
in such a way that the answer called for would help determine to what 
extent the objectives were attained. When these questions have been 
chosen, evidence of the attainment of objectives must be collected and 
analyzed in light of the criterion questions. From this final anilysis 
of evidence or data comes the basic material used in formulating 
recommendations. 

After recommendations have been derived, decisions based on the 
recommendations must be made. The decisions may involve accepting or 
rejecting the recommendations or they may involve modifying philosophical 
statements, goals, or behavioral objections. In fact, these decisions 
may affect any part of the evaluation process. 



CHAPTER II 
METHODS AND PROCEDURES 



Conducting the Project 



This chapter presents a description of procedures involved in the 
Central .Kentucky Voeational Education Evaluation Project. It gives details 
of the funding of the project, the management scheme, orientation 
activities » workshops and conferences conducted, progress review meetings, 
materials used or developed, and other activities carried out. 

Funding the Project 



The chief problem encountered was the late date in the school year 
at which the project was funded. Without assurance of funds, the state 
project staff was unable to contact schools regarding their participa- 
tion. This delayed start was a major factor in the refusal of some school 
systems to participate in the project. It undoubtably caused a hardship 
for other schools in adjusting schedules for local project personnel. 

As the project progressed, it was necessary to adjust the budget 
periodically. 



Management of the Project 



Directors 

State leadership and assistance for the project was provided by 
personnel in the Kentucky Research Coordinating Unit for Vocational 
Education (KRCU) and the State Program. Evaluation Section of the Kentucky 
Bureau of Vocational Education. The project director was Dr. Floyd L. 
McKlnney, Assistant Professor, KRCU, University of Kentucky, Lexington. 
Assistant Project Directors were Mr. C. 0. Neel, Coordinator, State 
Program Evaluation, Supporting Services Unit, Bureau of Vocational 
Education, Kentucky State Department of Education, Frankfort, and 
Dr. Alfred J. Mannebach, Aissistant Professor, KRCU, University of 
Kentucky, Lexington. 

The responsibilities of the project directors called for them to 
carry out the following activities. 
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1. Initiate and conduct conferences ^and workshops to 
further develop the evahiation coinpetencles of re- 
presentatives from the cooperating schools. 

2. Provide for consultative service on evaluation of voca- 
tional education in general and within vocational fields. 

3. Provide for an evaluation manual, evaluation instruments, 
related materials and limited computer services. 

4. Analyze records, reports and other data from cooperating 
schools. 

5. Prepare and publish reports on the project. 
Regional Staff 

Staff members of the Central Kentucky Education Region who were 
involved in VEEP were: 

Claude W. Howard - Director 

Arthur Corns - Coordinator of Reimbursed Programs 

Walter Brown - Coordinator of Direct Operated Programs 

Kyle Raroey - Guidance Counselor 

Hetzel Cole - Business Manager 

Members of the regional staff were responsible for assisting in 
providing leadership for VEEP. They were also responsible for assisting 
those in the regional schools who required assistance in any of the 
phases of the project. 



University Groups 



Representatives from three universities and/or colleges within 
the region participated in the project. Those representatives were: 



Eastern Kentucky University 

Dr. Rober^rr^ B. Hill, Chairman 

Department of HEC 

Barrier Building 

Eastern Kentucky Univeri^ity 

Richmond, Kentucky 40475 



f 
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Dr. Alfred Patrick^ Chalman 
BtislneM Education Department 
Eaatem Kentucky Ihilveralty 
Richmond 9 Kentucky 00475 



Kentucky State Coltege 

Dr. William W. Bearden» Head 
Department of Industrial Arts 
Kentucky Sta^ College 
Frankfort » itettVucky 40601 

Pniveraity of Kentucky 

Jack McElroy, Instructor 
Unlveraity of Kentucky 
45 Dickey Hall 
Lexington » Kentucky 40506 

Billy J*>ice, Instructor 
University of Kentucky 
7 Dickey Hall 

Lexington t Kentucky 40506 



University and college personnel were asked to participate in all 
workshops » conferences » and progress review meetings so that their in- 
stitutions would be informed regarding the evaluation principles and 
procedures that were put into effect. It was hoped that the under- 
graduate and graduate programs in these institutions would benefit from 
the involvement of staff members in the project. 

The university and college representatives made valuable contri- 
butions to the meetings in terms of sharing with Owher participants the 
views of their institutions as well as their own experiences and opinions. 

Bureiu::;of Vocational Education 

/V 

Se vera l persons from the Bureau of Vocational Education were infolved 
in the VEEP effort. These persona were responsible for providing leader- 
ship and actively participating in VEEP activities. The Bureau personnel 
who were laftolved were: 

Dr. Garl/t. Lamar 

Assistant SuH^l^tendent of Public Instruction 
for Vocational Education 
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Charles D* Wade 
Associate Director 
Program Development Unit 

Mary Lois Williamson 
Associate Director 
Supporting Services Unit 

Steve Marcum 

Associate Director "7 
Progvam Operation Unit 

Regional Evaluation Task Force 

A task force con^osed of one^meinber from each of the vocational 
education regions of Kentucky was formed. Members of the Regional 
Evaluation Task Force were asked to participate in all workshops, coi 
ferences, and progress review meetings so that they would be better 
prepared to initiate the evaluation system in their regions. 

This Task Force was composed of the following persons: 
Ben L. Abraham 

Harlan Area Vocational School 
HARLAN REGION 

John M. Adams » Jr. 

Regional Coordinator of Reinibursed Programs 
SOMERSET REGION 

Dr. Charles Aebersold, Guidance Counselor 
Jeffersontown Area Vocational School 
LOUISVILLE REGION 

Richard Gates 

Regional Coordinator of Direct Operated Programs 
OWENSBORO REGION 

Stokley Hall, Guidance Counselor 
Bowling Green Area Vocational School 
BOWLING GREEN REGION 

Joyce P. Logan 

Regional Coordinator of Reimbursed Programs 
MADISONVILLE REGION 



Leroy Martin 

Regional Coordinator of Reimbursed Programs 
HAZARD REGION 

Junior Poling 

Regional Coordinator of Reimbursed Programs 
ASHLAND REGION 

Virginia Pratt 

Regional Coordinator of Reimbursed Programs 
COVINGTON REGION 

Kyle Ramey^ Guidance Counselor 

Central Kentucky Area Vocational School 

LEXINGTON REGION 

Bronelle Skaggs 

Regional Coordinator of Reimbursed Programs 
PAINTSVILLE REGION 

Jasies T. West 

Regional Coordinator of Reimbursed Programs 
PADUCAH REGION 



St^te Evaluation Task Force 

A task force > composed mainly of the directors of the divisions 
within the Bureau of Vocational Education, served in an advisory capa 
This group gave advice in the planning and administration of the proj; 
The persons who served on the State Evaluation Task Force were; 

Charles L. Bright, Director 
' Division of Business and Office Education 

Kenneth Carter, Director 
Division, of Distributive Education 

Ted Cook, Director 

Division of General Adult Education 

Janes Disney, Supervisor 

Division of Trade and Industrial Education 

Jack Hatfield, Director 

Division of Health Occupations Education 

James McGown, Director 
Interagency Relations 
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Doug McKinley, Coordinator 
Vocational Guidance Services 

Fred Martin, Director 

Division of Trade and Industrial Education 

C. Montgomery t Director 
Division of Agricultural Education 

" C. 0. Neely Coordinator 
State Program Evaluation 

Dorotha Oatts, Supervisor 

Division of Home Economics Education 

Christine Wallace^ Director 
Division of Special Programs 

Project Orientation 



Participation by schools within the Central Kentucky Vocational 
Education Region was on a voluntary basis. The project was announced 
in a letter signed by the Superintendent of Public Instruction, Wendell 
P. Butler and the Assistant Superintendent of Public Instruction for 
Vocational Education, Dr. Carl F. Lamar. The letter announcing the 
project was mailed in July, 1970 and a copy can be examined in Appendix 
(A) . 

The mailing of the announcement was followed by direct contacts 
by the project directors with the chief administrators of vocational 
schools and public school systems within the region* Visits with 
school administrators were conducted for the purpose of explaining 
the project in more detail and encouraging Ch« participation of the 
schools and school systems. During August of 1970, twenty-four visits 
to chief administrators of public school systems were carried out. All 
those visited were invited to attend or send representatives to a project 
orientation meeting. 

The orientation meeting was held on September 10, 1970. The meeting 
had a twofold purpose. First, representatives from vocational education 
regions throughout the state were to get an ovetvlew of the project ^ 
so that they would be able to interpret the subsequent flow of information 
dealing with the progress of the project. This Introduction to the 
material was felt to be itqportant since it was possible that a similar 
approach to evaluation would later be instituted on a statewide basis 
Secondly, those schools represented within the Central Kentucky Vocational 
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Education Region would have a final opportunity to become actively 
Involved in the effort. 

Those who attended the orientation meeting are listed in Appendix 
(B) . A copy of the program for the orientation meeting is found in 
Appendix (C). 

As a result of the meeting several of the vocational education regions 
had representatives who were aware of the scope and purposes of VEEP 
and, within the Central Kentucky Vocational Education Region^ nine public 
school systems, the arcs vocational school, seven vocational extension 
centers, and a school of practical nursing made formal commitments to 
the project. 

The commitment was in the form of a ''Memorandum of Agreement'' with 
the Kentucky Bureau of Vocational Education. A copy of the agreement 
is in Appendix (D) . The schools agreeing to participate in VEEP and 
their project directors were: 



Anderson County Public Schools 
Lawrenceburg, Kentucky 40342 

Bill Hideout and Vernon Sutton 



Bourbon County Public Schools 
Paris, Kentucky 

George Stewart and Clara McCracken 



Central Kentucky Area Vocational School 
Vo*-Tech Dtive 

Lexington, Kentucky 40504 

Arthur L« Morgan and Errle' Shaffer 

Clark County Vocational Education Extension Center 
Winchester, Kentucky 40391 

Dover Comett and William C. Berry 

Danville School of Practical Nursing 
Danville, Kentucky 40422 

Moseill B. Jester and Virginia Tcwles 

Fayette County Public Schools 
Lexington, Kentucky 40522 

Eddie Murphy and Willard Clawson 

Fayette County Vocational Education Extension Center 
Lexington, Kentucky 40503 

Kenneth Blair and Harold Taylor 
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Frankfort Independent Schools 
Frankfort, Kentucky A0601 

Alice Samuels and Jim Smith 

Franklin County Vocational Education Extension Center 
Frankfort, Kentucky A0601 

John A. Stallard and Blane Hawkins 

Garrard County Vocational Education Extenslor. Center 
Lancaster, Kentucky 40444 

Gabriel U. Gabriel and Charles Thomas 

Harrison County Vocational Education Extension Center 
Cynthiana, Kentucky 41031 

William Lockhart and James Plumner 

Harrodsburg Vocational Education Extension Center 
Harrodsburg, Kentucky, 40330 

John C. Thomas and Lawrence Hendren 

Jessamine County Public Schools 
Nicholasville, Kentucky 40356 

Portia House and Ann Daugherty 

Lincoln County Public Schools 
Waynesburg, Kentucky 40484 

Ralph Estes and Darrell Story 

Madison County Vocational Education Extension Center 
Richmond, Kentucky 40475 

Donald Turpin and Lowell Brandenburg 

Mercer County Public Schools 
Harrodsburg, Kentucky 40330 

Walter Rowe and Howard F. Whitehead 

Scott County Public Schools 
Georgetown, Kentucky 40324 

Victor Johnson and Thomas G. Radford 

Woodford County Public Schools 
Versailles, Kentucky 40383 

James Wild and Willie Lee Caywood 

Responsibilities of the cooperating schools included the: 

1. Initiation and administration of a local evaluation project 
in line with general guidelines provided by the State 
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Project Staff. (The determination of the definition 
and scope of vocational education was a perogative 
of the cooperating school.) 

!. Provision of time for local project director and 
assistant director conanensurate with the size of 
•chool and scope of the vocational education program. 

I. Provision of essential clerical services and facilities. 

. Maintenance of appropriate records of activities aiid the 
preparation of reports on the local project. 

. Requesting consultant services appropriate to needs. 



Workshops and Conferences 



The VEEP directors felt that in-service activities for those involved 
in the project were critical. All participants needed common experiences 
both to encourage better connunication and to provide needed background 
information to those responsible for local evaluation activities. 

Local project directors and assistant project directors attended 
a four-day workshop which was split into two sessions. The workshops 
were conducted on September 21-22, 1970, and October 26-27, 1970. It 
was designed to assist vocational education personnel in the local and 
regional institutions of public education of the Central Kentucky 
Region to acquire the abilities and knowledge needed to conduct a 
locally-directed program evaluation effort. More specifically, the 
workshop was designed to enable the participants to be more proficient 
in: 

Identifying community and individual needs, 

2. writing a vocational education philosophy, 

3. writing performance objectives, 

4. Identifying the essential elements of a product- 
driented program evaluation effort, 

5. writing a product-orient-d evaluation plan, 

6. Identifying the steps In organizing and using 
a citizens advisory committee. 
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7. developing and administering follow-u^ inatrunenta 
according to successful practicea as evidence by 
reaearchy andt 

8. analysing data and developing renonmandations based 
upon the analysis of data. 



To assess the attitudea of the participants toward the arrangements » 
purposes » and program for the workshop, a Workshop EYsluation Scale vas 
adapted from a acalr designed by Weldon (11). The acale vas administered 
to partially evaluate the effect of the workshop. It waa given at the 
end of the workahop to fotcy*two individuals who were present at the laat 
aeasicn of the workshop^ A copy of the Workshop Evaluation Scale can be 
found In Appendix (E). 

Each item on the scale w.ns scored on the degree to which the 
participants agreed with the statements indicating a favorable attitude 
toward the workshop and disagreed with the statements indicating an 
unfavorable attitide. 

Scorea of five, four, three, two, and one ware assigned to favorable 
statements with responses of strongly agree, agree, undecided, disagree, 
and strongly disagree, reapectlvely. The scoring scale was reversed for 
unfavorable or negative atatements. The data was then sunmiarised. The 
number of reaponses to each category on each item and the mean response 
for each item on the acale are preaented in Table I. 

As revealed by the data in Table I, the reaction of the participants 
to the workshop was favorable. The range of the mean responses on the 
items was from 3.5 to 4.4. The total mean for all itemfi was 4.00. This 
finding indicated that, aa evidenced by the responses on the Workshop 
Evaluation Scale, the participants were largely satisfied with the 
arrangement a, purpoaes, and content of the Workshop. Further information 
on workshop acitvitiea and organization can be found in another project 
publication, entitled Workshop Proceedinga . 

The one«*day workshops on determining performance objectives were 
conducted in conjunction with the project. The workshops on performance 
objectives grew out of a need to better Justify the expenditures of public 
funds for educational pwposes. The development of realistic, explicitly, 
defined, measurable performance objectives is a basic starting point in 
an evaluation effort directed at providing better educational programs 
for students. 

These one-day workshops were felt to be one way of helping those 
involved in VEEP to gain coiq)etence in writing performance objectives 
for their areas of specialization. It was hoped that those who 
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participated in the workhsops could provide the leadership needed to 
help other vocational educators to revise and, develop relevant, measurable 
objectives. The Bureau of Vocational Education staff members who attended 
were, for example, in a position to assist vocational educators at the 
local level in developing performance objectives. In addition, the local 
project directors and assistant directors gained the coii5)etencies they 
needed so that the initial steps in the evaluation activities could begin. 

The one-day conferences on writing performance objectives were held 
on November 10, 1971 and November 11, 1970 

Progress Review ^Ieetings 

Five progress review meetings were conducted during the course of 
the project. The purposes of these meetings were: 

1. To provide project teams with consultative services 
regarding areas of concern. 

2. To provide an opportunity for interaction among project 
teams in small group settings. 

3. To provide project teams with directions for future efforts. 

4. To provide a channel of communication between local 
project teams and the project directors and consultants. 

Consultants were widely utilized in the progress review meetings. 
For the first progress review meeting. Dr. Robert T. Norton, Assistant 
Professor, Department of Vocational Education, University of Arkansas. 
Fayettevllle, served as a consultant. This meeting was held on Novembcir 
20, 1970 in Patterson Office Tower, University of Kentucky, Lexington, 
The focus of Dr. Norton's presentation was on a vocational education 
evaluation project carried out in Arkansas. 

Mr. John Odgers, Director, Division of Guidance and Testing, 
Ohio State Department of Education, served as a consultant to the 
second progress review meeting held on February 2, 1971 in Lexington. 
Mr. Odger's presentation dealt with the use of the Ohio Vocational 
Interest Survey (OVIS) in vocational education evaluation efforts. 

The consultant to the third progress meeting, on March 9, 1971, 
was Dr. John Coster, Director, Center for Occupational Education, North 
Carolina State University, Raleigh. Dr. Coster presented several brief 
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observations on the presentations in the small group meetings which he 
visited earlier in the session. 

The fourth progress review meeting took place on April 27, 1971. 
Dr. Harold M. Byram, Professor, College of Education, Michiga.* State 
University, East Lansing, served as consultant. Dr. Byram spoke on 
implementing evaluation findings. 

The final review meeting was conducted by personnel from schools 
participating in the project and the state staff. This review meeting 
was devotod to a summary and analysis of the activities conducted during 
the project year. 

Representatives from the local project teams, the Bureau of Voca- 
tional Education, and interested colleges and universities attended the 
progress review meetings. A typical program rrom one of the progress review 
meetings is found in Appendix (G) . Small group activities were built 
into the meetings so that a maximum amount of interaction between 
participants could occur. 

Project Monitoring 



The state project staff attempted to maintain close contact with 
the members of the local leadership teams through monitor visits , 
telephone calls, individual letters and general letters. The group, 
visited most of the local project schools in October and November, 1970, 
and individual visits were made to each school throughout the project 
year. The purposes of these visits varied from making presentations 
at staff or citizen's advisory committee meetings to conferences with 
members of the local leadership team. Members of the regional staff for 
vocational education participated in some of the monitor visits . Members 
of the state project staff were assigned to specific schools for mon- 
itoring purposes. This procedure conserved time and effort of the state 
staff, however, it did not mean that a state staff member never visited 
a school not assigned to him. (See Appendix (H) for a list of staff 
monitor assignments) . Reports of the monitor visits were prepared by the 
state staff members and disseminated to personnel in the local schools, 
other state project staff members, and to members of the regional staff 
for vocational education. 

The use of telephone calls and letters was extensive in the monitoring 
effort in order to give immediate help when problems arose at the local 
level. In addition, dates and times for visits were set up and confirmed 
through these media. 
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Instrumentation 



A major activity carried out at the local level was a follow-up 
of former stiidents. 

The objectives for the follow-up system were: 



General Objectives ; . 

1. To acquire follow-up data on former students in the 
vocational education system in the Central Kentucky 
Region. 

2. To acquire data, to be used in program planning for 
vocational education. 

Specific Objectives 

1. To acquire data reflecting the number of former 
students of the Central Kentucky Vocational Education 
system who (at time of this study) are employed and 
unemployed. 

2. To acquire data on the number of former students in 
the Central Kentucky Vocational Education Region who 

have moved from the area in which they received vocational 
training. 

3. To determine whether or not graduates of the Central 
Kentucky Vocational Education System are continuing 
their education. 

4. To determine the reasons former students continue or 
do not continue their education. 

5. To acquire data concerning the time lapse between 
graduation (exit from) vocational education and 
acquisition of full-time employment. 

6. To acquire data reflecting the success of the Central 
Kentucky Vocational Education System in educating 
former students for: 



A. Occupation of their choice 

B. Occupation for which they are qualified 

C. Level of attainment they desire 
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7. To acquire data concerning the relation of vocational 
education programs taken to the actual occupation 

of the former students • 

8. To obtain feed-back informHtion from former students 
including: 

A. Satisfaction/Dissatisfaction with vocational 
education taken # 

B. Eecoonendations for inqprovlng tihe vocational 
education systems. 

C. Type of education the graduate vould have 
taken in retrospect. 

D. Type of education former students are taking 
or vould take (given the opportunity) . 



The State Project Staff assumed the major responsibility for 
developing the former student follow-up instrument. Copies of proposed 
questionnaire items were reviewed by the local project personnel, 
regional evaluation task force members » and the m«mbers of the state 
evaluation task force* The instrument was printed and disttibuted to 
the schools participating in the project* Most schools followed up the 
freshman class of 1962. A few schools followed up additional classes. 
When former students had returned the instruments, the local school 
forwarded them to the state project office. Data processing was 
carried out at the Northern Kentucky Area VocHtional School. 

An attempt was made to add flexibility to the follow-up instrument 
by allowing local schools to add questions they billeved to be unique to 
their situation. Under the leadership of Mrs. Dorotha Oatts, Kentucky 
Bureau of Vocatioiial Education, a supplementary follow-up instrument for 
former students in homemaking was developed and used by a nuid>er of the 
schools. 

The expense of developing, printing, and distributing the ins t rumen 
as well as processing the data, was included in the project budget. 
Copies of the follow-iq) Instrument are found in Appendix (I) and (J). 
Twelve schools or school systems participated in the former student follov- 
up* 

Nine schools utilised the Ohio Vocational Interest Survey (OVIS) in 
their local evaluation efforts. The use of OVIS to ascertain the vocational 
interests of students was a valuable input to the evaluation project. 
The results of the OVIS, used in conjunction with the Dictionary of 
Occupational Titles (DOT), the Occupational Outlook Handbook, and the 
General Aptitude Test Battery, gave various project teams added insists 
into areas of future emphasis for vocational educStion programs. 
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The expenses associated with acquiring the OVIS instruments and 
getting them scored were Included In the VEEP budget. The state project 
staff was responsible for acquiring the Instruments, forwarding then to 
the schools, and having the tests scored. 

VEEP project funds also provided for an instrument called PRIDE 
which was xxsad in a survey of parents and students. The respondents 
had an opportunity to indicate their attitudes or feelings about the 
school's vocational education curriculum, guidance services, financial 
aspects, facilities and equipment, and staff. The PRIDE Instrument 
was used by three school systems in order to get direct Inputs from 
parents and students concerning their perceptions of the various 
components of the vocational education program in the schools. Again, 
the state project staff assumed the responsibility for securing the 
instruments and having them scored. 

Brochure 



A sixteen page booklet was developed by the state project staff. 
The brochure, entitled VEEP - Central Kentucky Vocational Education 
Evaluation ri.jject ^ explained the background for the project, presented 
the objectives, discussed focal points, described the activities planned^ 
and listed the participating institutions, project leaders, task force 
members, and state project staff members. The brochure was distributed 
to all vocational education personnel in Kentucky and to selected 
individuals on a national basis. This dissemination effort was an attempt 
to provide information about the product to those persons for whom the 
outcomes would have direct implications. 

Newsletters 



An extremely important dissemination activity was the publication and 
distribution of a project newsletter, VEEP-News and Views . The purpose 
of the newsletter was to keep local project personnel and other educators 
informed about the procedures and techniques being used in the project. 

Articles for the newsletter were written by members of the state 
project staff and local project leaders. The articles described various 
aspects of the total project and various unique aspects of the local 
efforts. In addition, references to articles, books, and publications 
of possible interest and a calendar of upcoming events were included. 

The state project staff was responsible for editing the newsletter, 
having it printed, and distributing it. The newsletter was mailed to 
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References PRovipgn 



r.fo.I^ involved in VEEP were provided with bibliographies of selected 
references on vocational education evaluation, the use of local citizens' 
advisory committees, and educational obJectiv;s. A docSmeirUsting 

Ji^ns^'CaTard^SiXr^ ^"^"'^ ^^'^ -^^^ 



Reporting 



Quarterly reports were written by the state project staff covering 
the entire VEEP effort. Major activities and accomplishment during 
the period were discussed, problems were identified, significant findings 
and events were pointed out, dissemination activities were listed, and 
future activities were presented, items of interest, such as agenda . 
and minutes of progress review meetings, instruments to be used for 
various purposes, and observations of consultants, were appended to the 
report. 

The local project teams also submitted quarterly reports to the 
state staff. These reports followed the same format as the state 
reports. Attention was given to local problems and concerns and to the 
details of local evaluation activities. The local project quarterly 
reports provided a basis for much of the infonaation contained in the 
state staff quarterly reports. 

Several reports on workshops and conferences conducted during the 
project were published. One report was devoted to the proceedings of the 
project leader s workshop held on September 21-22 and October 26-27. 1970. 
This report explained the background and objectives of VEEP, listed* 
activities and participants, presented the program agenda, discussed the 
procedures followed, and included the presentations made at the workshop. 

Reports were developed to summarize the proceedings of the progress 
review meetings. Summaries of the presentations and reports on the 
small group meetings were included. 

Reports on other meetings, such as meetings with consultants and/or 
local project leaders were written. These reports were suiararies of the 
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major points covered and included the conclusions reached and recommendatioi 
put forth. 

Publicity 



VEEP was widely publicized in order to inform the public about the 
purposes and activities of the project. V«rioU6> news media were utilized. 

The project received publicity on the evening news of Channel 27 in 
Lexington, Kentucky when the project director was interviewed at the 
workshop on September 21. News releases were sent to the Lexington 
and Louisville newspapers. Articles about VEEP appeared in the Kentucky 
Department of Education School News and in the Kentucky Bureau of Voca- 
tional Education Vo-Ed Highlights ♦ One of the articles in School News 
was a feature article* Similar articles appeared in the Kentucky Research 
Coordinating Unit Newsletter , in the University of Kentucky Communi-K 
and in the University of Kentucky College of Education Newsletter * 

A iseries of 35 mm color slides was developed to graphically depict 
the project* These slides were used with local, regional, and national 
groups* Their major local use was in connection with state project staff 
presentations to local staff and citizen groups* A set of transparencies 
also proved helpful in various meetings* 

Probably the most important dissemination efforts were made at the 
local level* Several of the participating schools received publicity 
about their evaluation efforts in local and regional newspapers and on 
local and regional radio stations* Sotrte assistance for local directors 
was provided by the state project staff* Pictures of local representa- 
tives were taken at the workshops. The pictures, accompanied by a news 
story, were made available to local newspapers* The news articles were 
also sent to local and regional radio stations* 

The project was reviewed by the director at the November meeting of 
the Advisory Committee for the Kentucky Research Coordinating Unit and at 
the November 25 meeting of the EPDA Planning Institute in Frankfort, 
Kentucky* 



CHAPTER III 



ORGANIZING FOR THE EVALUATION 
ACTIVITY IN THE SCHOOL SYSTEMS 

The followlt.g chapter deals with the organizational activlti.. 
carried out and the rel.tio„.hips established' at tieTcatle^el " 



Importance of Organizing for Evaluation 

Doint^ *^ involvenent as one focaX 

"ogrSL""'*"''" • °^ vocation!! eS^c.tio^ 

^« « J^* ^''^^^ persons with leadership abilities were appointed ' 

to organize and coordinate the evaluation activities. These SadeJsWo 
teams were appointed by local school administrators? It was onJf ^ 
through many dedicated hours of hard work by these individuals tLt th. 
programs and activltiea of VEEP were carried out. ^^e 

"^"'^^y * P"J"t director and an 

assistant project director, had the initial task of organizing the 
evaluation effort. It was their job to involve people^ocany InJ 
allocate the limited resources available. ^ 

inri.Jl;j Organizational scheme for involving people at the local level 
included the use of staff, student, and citizen advisory committees. The 
f organized and charged with definite responsibilities, and 
Meting schedules were arranged. These groups functioned smoothly a^d 



Administrati ve Cqmmit mp^)t 



No evaluation activities associated with VEEP could have been 
carried out without firm comltments from administrators iJ^e School, 
and school systems in the Central Kentucky Region. Those administrative 
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leaders who made a commitment to VEEP also committed thetnselves to local 
school personnel. They, in effect, said that limited resources would be 
provided according to availability and that due consideration would be 
given to the findings and recommendations that resulted from the evalua- 
tion effort. 



The importance of this pledge to the project can be inferred from the 
responses to an item on the VEEP Interview Follow-Up instrument. Wheii 
local project leaders were asked to indicate the value of administrative 
conmltnent, twenty-five indicated that it was of great value, ten responded 
that it was of some value, and only two believed it was of no value. These 
strong positive responses suggest that administrative commitment is a 
definite factor in a successful evaluation effort. 

When administrative commitment to the project had been secured, atten- 
tion was turned to the importance of orcanizing for e\'aluation. 



Organizational Pattern for the School 



Typically, the project was initiated in a school system by the chief 

administrator. He informed the board of education and school staff members 

of the need for evaluation and the extent of involvement required. A pledge 

to cooperate in VEEP was made only after the board of education and school 
staff members made a commitment to the program evaluation effort. 

The next step was to appoint a local project leader and assistant 
project leader. Usually, the project leader was the local director of 
the vocational education program. The local leaders were provided with 
limited clerical help, equipment, supplies, and travel funds. They were 
allowed released time for attending meetings, working with teachers, com- 
mittees, and employers, and for research and development activities. The 
initial development activity was the writing of an evaluation plan, with the 
assistance of teachers and advisory groups. Local leaders were also assisted 
by the VEEP state Staff and outside consultants. 

The local leadership team organized several committees to perform 
various functions. A staff committee was formed within each school. 
The responsibility of the staff committee was to conduct a study of the 
vocational education program in order to determine the extent to which 
the program was achieving the established objectives. 

The local staff committee: 

- became familiar with the objectives of VEEP, 

- assisted in the preparation of the evaluation plan, 

- assisted in writing the vocational education philosophy, ♦ 
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- assisted m writing program and course objectives 

- assisted in data collection, ojeccives, 

' TJiVr^i J" Interpreting data, and 

- assisted m the fonmilatlon of reconnendatlons. 

The typical staff conunittee was composed of several vocational edn^»rin. 
teachers and a principal, counselor, or non-vocationri teacLj. 

Student Committee 

«^ A conanittee was fonned, composed of approximately ten 

of the «tuLr" teachers J^e^JSers 

of the student committee selected their own officers. About flvr 

Sa^^'L'n):"' '"^'"^ ^P^-^^'^ and'th'e':on«ittee 

The committee engaged in several activities. The most frequent 
were assisting with the. former stndent follow-up study ^d pa«?clnatln. 
in the formulation of recommendations. participating 

The student committees made the following suggestions: 

- there should be free discussion of issues within the 
student committees, 

- student committees should evaluate their own efforts 

- accurate records of committee meetings should be kept, 

- students should be Involved in evaluations regarding 
the Improvement of vocational course offerings, 
facilities, and youth organizations, and 

- students of various grade levels should be represented 
on the committee. 

Final reports received from project leaders indicated that student 
committees made a significant contribution to the evaluation efforts 
In the schools. They had Important Inputs to program planning and 
implementation as well as program evaluation. 

Citizens Advisory Committee 



Citizens advisory committees were also organized. There are several 
conceptual reasons why the advisory committees were felt to be essential 
The concepts were: 



- vocational education programs are organized to serve 
people according to their interest, needs, and abilities. 
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- an evaluation effort aimed at the systeinatic appraisal of 
vocational education programs should be undertaken, 

- knowledgeable citizens can provide valuable information 
and advice relative to program improvement, 

- The public wants and deserves to be informed of findings 
and recommendations which result from an evaluation project, 
and 

* vocational education sincerely welcomes the contributions 
that lay people can provide for program planning and 
evaluation* 

Typically, the citizens advisory committees had the following 
purposes : 

- to assist in identifying and describing occupational 
education needs, 

- to express opinions concerning the products of the vocational 
education process, and 

- to assist in summarizing, analyzing, and interpreting 
data. 

Citizens advisory committees were established by governing boards 
or representatives of these boards. Generally, the committees had only 
the authority to give advice to be used in the planning and evaluation 
of programs. Committees were composed of persons from local communities 
who were not employed educators. A citizen member served as chairman. 

The value of the citizens advisory committee to the project was 
demonstrated in the Interview Follow-Up. When asked what value citizens 
advisory committees were to the evaluation effort, twenty-two local 
project leaders listed them as of great value and seventeen indicated that 
they were of some value. None of those re«poading felt that these 
coomilttees were of no value at all. 

At this point, then, the administrative comnitment had been rnade^ 
leadership teams chosen, and committees formed* The task now was to 
develop an evaluation plan. 

The Evaluation 

Evaluation plans were formulated cooperatively by local project 
leaders, the staff committee, the student committee, and the citizens 
advisory committee. The planning occurred after all who w#»re involved 
had received an orientation to systematic program evaluation procedures* 
This cooperative planning allowed each group of individuals involved 



to fully comprehend the scope of the effort and to determine their 
sponsibilities and roles. 



A typical evaluation plan Included the following: 

1. a description of the situation in the area served; 

2. written objectives for the local evaluation effort; 

3. responsibilities of leadership team» local staff 
committeey citizens advisory committee^ and student committee 

4. identification of boundaries or limitaticms; 

5. evaluation activities to be conducted to assist in 
attaining the objectives of evaluation effort such as: 

a) study of the local program of vocational education » 

b) survey of local employment opportunities^ 

c) review of local philosophy of vocational education » 

d) review or writing of the vocational education program 
objectives and instructional px'^gram (course) 
objectives » 

conduction of a study of student characteristics ^ 

f) formulation of criterion questions^ 

g) conduction of fonaer student follov-up survey » 

h) conduction of cost-effectiveness studies^ 

i) establishment of a system for keeping evaluation 
records t 

J) determination of competencies for specific jobs^ 
k) analyzation^ implementation » and reporting of 

information » and 
1) formulation of recommendations; 

6. budget items and estimated cost; 

7. schedule of activities; 

8. method of dissemination; 

9. plans for implementation; 

10. evaluation of the evaluation plan; and 

11. procedures for incorporating evaluation as part of the 
on-going program of vocational education. 
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th^ o3i? organizational activities contributed greatly to the success of 
the evaluation effort. Without a systematic approach to the inSveLnt 
of people, little would have been accomplished. mvoivement 



CHAPTER IV 



ACTIVITIES IN THE SCHOOL SYSTEMS 

r.rr t^Tl"" is devoted to describing the activities that were 

carried out during the project year within the schools and school systems. 

Summary of Activities 

Vll ^^^^^"^ participating in VEEP carried out numerous 

activities during the project year. Activities conducted by many of the 
school systems during the year included: y y 

- development of a philosophy of vocational education, 

- development of objectives for programs and courses, 

- conduction of a former student follow-up study, 

- conduction of staff visits to businesses and industries, 

- conduction of a parental survey, 

- conduction of a vocational interest study, 

- conduction of an employer survey, and 

- conduction of a part-time work inventory study. 

All of the schools involved developed philosophy and objectives for 
their programs of vocational education. A majority conducted a former 
student follow-up study. Approximately half of the schools conducted 
staff visits to businesses and industries and/or conducted a study of 
student vocational interests. 

As was expected, not all the schools had the time or resources necessary 
to carry out all the activities listed. In addition, a number of special 
constraints were involved. For example, one new vocational extension 
center could not conduct a former student follow-up study since there were 
in fact, no former students. * 

Philosophy and Objectives 

As noted, all eighteen schools and school systems developed a philosophy 
of vocational education. For the most part, the development of a philosophy 
was a cooperative undertaking within the schools. Inputs came from the 
local leadership team members, students, local school personnel, and local 
citizens. 
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^^'^yPi"^ statement of philosophy contained the broad purpose for 
vocational education. It stressed the realtlonshlp of vocational 
ZXT P«P"ation for life. Furthermore, an 

emphasis was placed upon the responsibility of educators for guiding and 
directing students In their preparation for careers based on lleir^ 
interests, needs, and abilities. 



Former Student Follow-[Ip 



Twelve schools used a follow-up Instrument developed as a part of 
the project. Two schools conducted a former student follow-up study 
utilizing a follow-up instrument developed In a separate study. Most 
schools surveyed the freshman class of 1962 and some schools examined 
additional classes. 

A total of 2,158 questionnaires were sent to former high school 
students. The number of questionnaires returned was 1,109, a fifty-one 
percent return. Of the 519 questionnaires sent to former students of 
extension centers, 187 were returned yielding a rate of return of 
thirty-six percent. 

Most schools used study procedures outlined in a VEEP document which 
was adapted from materials developed by Dr. 0. Donald Meaders at Michigan 
State University. This document is included in Appendix (L) . 

Information output resulting from the processing of the data on former 
students was transmitted back to the local schools to be used in their 
evaluation efforts. A summary report of all the follow-up studies was 
developed and used as the basis for a presentation at the final VEEP 
meeting. 



Home Economics Follow-Up 



The home economics departments of twelve high schools within the 
region conducted follow-up studies of. former home economics students. 
The Instrument used was developed by Dorotha Oatts, Willie Lee Caywood 
and Dixie Hester. It is Included in Appendix (J). * 

A total of 726 questionnaires was mailed out. The number returned 
was 194 for a twenty-six percent return. Most of the students in the 
study were from the freshman class of 1962. 

The mailing procedures , data processing procedures, and reporting 
procedures were the same as those used in the former student follow-up 
studies described above. 
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PTHEt Studies 

systei'^^Jloyed^hfoLf Voc'L^'^n'? conducted. Nine schools or school 
of the vocational Jnterestl ofstud^^^ 1^^'' ^^'^''^ 

was used with ninth-grade students ^.7 P"'' Instrument 

a valuable input to th^^o^-^ ? . Information provided served as 

uaoie input to the total planning and evaluation effort of the project. 

As has been pointed out, the state project staff secured th^ 
and arranged for scoring. The instruments were aS^niste^S wUhlJ t^f^"^ 

itm: ^^t^^:^^ — - ---- 

This instrument is designed to aseprtain nar.»««. j "^"^^^^ earner, 

vocational education, ascertain parent and student opinions of 

The student form was administered in the schools. The instrument 

portLT ? '° P"^"'^ °^ completed tjnjident 

portion. In all, 769 students and 535 parents participated, scuaent 

surve^^ developed its own instruments for use in the parent student 

h«nHiff ^'.r"''^"^ °^ Instruments and details relative to scoring were 
handled by the state project staff. ov.""ub were 

^""^"^ ^^^^^"^ developed two instruments as a part of its VEEP 
whetiir ^t'd ' Disability and Health Survey designed to deS^ne 

Se ^tLr r p^^r P^y«^"lly "P«ble of engaging in Various actiJJties. 

Zvt-T±^ 1obs\ ^"T^ ^° ""'^ kinds of 

I ^^1^ ^^^^ students and the effect of these jobs on students. 
All details concerning the development and administration of these 
instruments were worked out by the local project teams. 

One school system utilized the General Aptitude Test Battery (GATB) 
in order to determine what the aptitudes of students were toward 
occupational areas. The results of the GATB can be closely tied to the 

a^mJtiel. '''' vocationa"^idance 

VFFP conducted studies of student characteristics as one 

IftLrlJ ^^^^^y- or another, these schools 

gathered data, such as enrollment by grade level, sex by grade level 
educational level of parents, interests of students, socio-economic * 
backgrounds of students, and needs of disadvantaged and handicapped 
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students. The data gathered were used to describe the student population 
to be served. The accumulation of data and the resulting information about 
students was considered a vital evaluation activity in these schools. 

In addition, two schools conducted a study of employers in their areas. 
They introduced an instrument designed to gain insights into what 
employers thought about employees who had received vocational training. 
The instrument was also used to assess enqployer attitudes toward voca- 
tional education in general. Again, the local project teams were 
responsible for carrying out these studies. A copy of the employer 
questionnaire is in Appendix (M) . 

Visits to Business and Industry 



Members of the staffs of eight participating schools or systems made 
visits to businesses and industries in their local areas. The purpose 
of the visits was twofold. First, they provided teachers and other 
staff members with opportunities to find out what current policies, 
practices, and procedures were being used in business and industry. 
Secondly, it gave businessmen an opportunity to find out what kinds of 
activities the schools were engaging in as they attempt to improve 
instructional programs. 

The local school systems provided release time for staff members to 
make visits. One major problem area for the systems that did not use 
staff visits to business and industry was lack of financial resource? for 
granting release time. 

Reports and Records 



The state project staff maintained records of visits to VEEP schools. 
These records consisted mainly of an outline of points covered in the 
meetings. Special attention was given to the position of each school 
relative to specific evaluation activities. In addition, a file of 
incoming and outgoing correspondence was maintained. 

As was noted earlier, each local project team submitted quarterly 
reports of their activities to the state project team. The state project 
team then developed quarterly reports summarizing all the VEEF activities 
and events for the period. 
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Analyzing Data and I^aking Recommendations 



The analysis of data relative to local studies was a combined effort 
by the local project teams » local school administrators » local advisory 
committees » and the state project staff. When the data collected was 
analyzed^ a basis for making recommendations was established* The 
recommendations which were formulated and agreed upon were then put into 
effect in the school systems. 



CHAPTER V 



OUTCOMES OF THE EVALUATION EFFORT 



The outcomes of the Central Kentucky Vocational Education Evaluation 
Project will be presented as they relate to the- objectives outlined for 
the project. The outcomes were identified from an analysis of (1) interviews 
with local leadership team members, (2) an interview follow-up form 
completed by local project directors and assistant directors, and (3) other 
documents such as quarterly and final reports submitted by project teams* 



The first objective of the project was to identify new or improved 
procedures for assisting schools in conducting program evaluations* 
Thirty-nine persons responded to the VEEP interim follow-up instrument* 
Of this number > thirty-four persons indicated that the conference on 
determining performance objectives was an improved method for assisting 
schools in program evaluations. 

Tweaty-six persons mentioned the development of procedures for 
conducting former student follow-up studies as being a procedure identified 
in VEEP. Twenty- four respondents indicated that the procedures for the 
establishment and use of advisory committees was an outcome of the VEEP 
project. 

Several other outcomes seemed to be considered important by re- 
spondents. Thirteen persons mentioned the value of the workshops » 
meetings » and state assistance. The feeling was that» at least to the 
local project directors, these were new or improved procedures for 
assisting schools in program evaluations. Twelve persons indicated 
that they felt that the establishment of procedures for using the OVIS 
instrument in determining the vocational interests of students was a 
valuable outcome. The focusing of evaluation efforts on the development 
of a written, systematic evaluation plan was listed by ten persons as an 
outcome which was of great assistance. The conduction of the parent-student 
survey to ascertain attitudes or feelings about local vocational education 
programs was mentioned by eight persons as a procedure which seemed to 
be of value. Finally » seven persons indicated that they felt that one 
important aspect or outeome was the organization and involvemant of 
personnel at the local level. 



Objective One 
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Objective Two 



Respondents were asked whether evaluation procedures were demonstrated 
which would determine If secondary and post-secondary vocational education 
programs In Central Kentucky were fulfilling stated objectives. Thirty- 
three respondents Indicated that they felt such procedures had been 
demonstrated. Three persons felt that such procedures had not been 
demonstrated. The persons who answered in the negative did not indicate 
what methods or elements they felt were missing. It seems that, in the 
opinion of the local leadership team members, the evaluation project met 
this objective. 

Objective Three 

The third objective was to develop state and local leadership com- 
petencies needed for evaluating programs of vocational education. An 
item for assessing the degree to which local leadership team members felt 
this objective was achieved was Included in the follow-up. 

Twelve respondents felt that VEEP had not contributed at all to the 
development of leadership competencies at the state level. Fourteen 
persons indicated that VEEP had contributed greatly to the development 
of competencies at the regional level; while nineteen persons, the remainder 
of the respondents, felt VEEP had contributed to some extent at this 
level. In regard to the development of leadership competencies at the 
local level, sixteen respondents felt that VEEP had contributed to a 
great extent, and sixteen felt VEEP had contributed to some extent. 

Objective Four 



VEEP also was designed to help personnel In local and regional 
-schools to become more proficient In performing various planning and evaluation 
functions. The responses to the Item which directly attempted to assess 
whether this objective was met are presented In Table II. 
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TABLE II 

RESPONDENTS REPLY TO WHETHER OR NOT VEEP ENABLED 
THEM TO BECOME MORE PROFICIENT IN PERFORMING 
VARIOUS PLANNING AND EVALUATION FUNCTIONS 



Evaluation and Planning Functions 



Respondents Reply 



Yes 


No 


35 


2 


34 


3 


37 




39 


0 


39 


0 


38 


0 


36 


0 


33 


3 


33 


5 



Identify community needs 

Identify individual needs 

Write performance objectives 

Identify essential elements of a project 

Oriented program evaluation effort 

Write a product-oriented evaluation plan 

Identify the steps in organizing and using 

a citizens* advisory committee 
Develop and administer follow-up instrument 
Analyze data 

Develop recommendations based upon the 
analysis of data 



It is apparent that the overwhelming majority of respondents felt that 
this objective was achieved to a %Te'at extent. 



Other Outcomes 



From the responses recorded in interviews with members of local 
project teams, it seems clear that they perceived many other outcomes 
of the project. Several persons thought that changes occurred in their 
schools as a result of their participation in the project. Among the most 
often mentioned changes were replies such as, "We have increased and en- 
hanced our public relations"; and "We now have teachers, students, and 
citizens involved in evaluation." Others felt that the image of vocational 
education had been enhanced. Some noted that teachers and other staff 
members were now committed to continue evaluation efforts. Several team 
members mentioned that courses were changed, added, or dropped. One 
school found that enrollment in vocational courses had increased. 

A further outcome of the project was a published report of a study 
conducted as a part of VEEP. The publication, entitled. Study of Student 
Committees on Evaluation reported an attempt to discover the more 
successful organizational patterns for effective involvement of students. 
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The study was conducted and reported by Floyd L. McKinney and Alfred J. 
Mannebach. Another study concerning the organization and use of citizen 
advisory committees was conducted by Floyd L. McKinney and Robert 
Wheat ley* 

Relative to the outcomes associated with the schools participating 
in VEEP, some conclusions can be drawn. Several new or iii5)roved procedures 
for assisting schools in program evaluations were identified. These 
procedures were tested or demonstrated in such a way that it could be 
determined whether* vocational education programs were meeting stated 
objectives. Leadership at the state, regional, and loeal levels was 
assisted in becoming more proficient in carrying out certain functions 
associated with program evaluation efforts. Attitudes toward vocational 
education and evaluation improved. Finally, changes in vocational education 
programs occurred as a result of evaluation activities. Hopefully, all of 
these outcomes will lead to better vocational education programs for 
students. 



Outcomes of the Project on a Statewide Basis 



VHiat implications are there for the rest of the State relative to 
the evaluation of vocational educations programs? Certainly, the 
project was only successful if its outcomes can provide a model for similar 
evaluation projects in other regions. 

The project demonstrated that locally directed — state assisted 
evaluation efforts can be successfully carried out on a regional basis. 
The emphasis on product oriented, vocational centered evaluations with 
local involvement and local objectives led to the development of a viable 
model for the evaluation of vocational education programs statewide. The 
objectives of VEEP were found to be r^ialistic, and the activities carried 
out were beneficial to those im^^olved. 



CHAPTER VI 
CONCLUSIONS AND RECOMMENDATIONS 



v« .1^ ^ 1/ Proiect staff has concluded that the Central Kentucky 
Vocational Education Evaluation Project demonstrated that locally 
dlrected-state assisted evaluation projects can and should be carried 
out In Kentucky. The public, asking for accountability from educational 
5!™!;^'°?* '^^^^^^s "° less. Consequently, several recommendations for 
developing and conducting such evaluation efforts are presented. 



Planning the Effort 



It Is recommended that sufficient time be spent In planning the 
evaluation effort. VEEP got a late start due to delayed funding. As a 
'TiS^n "''^yf schools were unable to participate. Projects the nature 
ot VEEP should not be carried out unless a maximum number of schools 
are Involved. Effective planning can eliminate problems of this type. 



State AssisxANrP 



It Is recommended that the Kentucky State Department of Education, 
through appropriate channels, provided assistance to those regions who ar 
willing to undertake a comprehensive evaluation effort. One kind of 
assistance provided should be In the form of expertise gained by State 
Department personnel through their participation In the VEEP activities. 
In addition, such financial assistance as Is available should be offered. 



Local Direction 



since representatives from each of the vocational education regions 
In the state attended VEEP workshops and meetings. It Is recommended thdt 
these persons assume leadership roles In Initiating evaluation projects 
within the regions. It Is further recommended that the VEEP scheme of 
using personnel within each school or school system as local project 
directors be followed. It Is recommended that these persons be released, 
at least part-time, from other duties so that they can give adequate 
attention to the evaluation effort. 
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Local Involvement 



It is the feeling of those who participated in VEEP that the 
involvement of teachers, students, and citizens at the local level is 
essential to an effective evaluation effort* It is recommended that 
local evaluation teams form and use advisory committees in their evalua- 
tion endeavors. Each of these groups should have input to the evaluation 
activities* Their input should be much more than just to the development 
of mailing lists or similar activities. Their interests and needs 
should be assessed and incorporated into the effort* 

The Educational Effort ' - 



It is recommended that regional educational meelings be held so that 
local personnel responsible for evaluation activities can gain the 
background they need for the job. The use of outside consultants, personnel 
from state colleges and universities. State Department personnel, and 
local personnel who are qualified is recommended. Workshops concerned 
with evaluation procedures and development of objectives should be 
organized and conducted. 

Attention must also be given to educating students and citizens about 
the purpose of evaluation. Through open meetings and the use of various 
news media, the evaluation effort can be made less threatening and 
support for the activities can be gained. 

Focus for Evaluation 

The evaluation efforts in regions across the state should be 
product oriented. The product of the educational program is its impor- 
tant aspect. More specifically, what happens to the possessor of the 
products gained in the educational system should be the concern. A 
product-oriented evaluation scheme centers around the development of goals 
and objectives for a vocational education program which is based on a 
philosophy of vocational education. 

If a product oriented evaluation effort is worthwhile, there must 
be measurable, behaviorally stated objectives for the programs. It is 
recoimnended that educators take whatever steps are necessary to assure 
that behavioral objectives are stated for vocational education programs. 
If this requires inservice workshops for local staff members, then those 
workshops should be conducted. It is only after objectives have been 
developed that a product-oriented evaluation can be conducted. 
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Studies 



data. 



T^TlT. T"" '^^^ °" ^^ly^i^ °f •''arlous types of 

«nd .t.Sl. f ''T^ ^'"^^^^ °f Present and former students 

and studies of employment opportunities In the area served by the oroeraL 

s"?Se^tr nL""r- studies ^ftrS^r'"'" 

™fnf 2J P u "^^'^ assessments of present students, and employ- 

ment studies of the region be conducted. 



fr l"!* experiences encountered In VEEP, the conclusion was reached 
SSla^ .iu!r"°^"S ""^'^ collection In VEEP are appropriate for 

similar studies. The use of OVIS to assess student's vocational Interests 

for»erS;d:;t^'"t.'°ii?:;;"? '^-^^^^^ determine what has ;apSn:d o * 
ooISIn vo. Instrument for assessing parental and student 

lllltr il f programs, and the other special Instruments mentioned 

avInaWe frJ™ ^H 'c ^^''T^''^^^' "^^^ analyzing data can be made 
Zutllll ^'^'^ Department of Education. Bureau of Vocational 



ftoNITORING 



"fhf e persons In leadership roles In regional and local program 
evaluation efforts should monitor those efforts closely. Close coordlna- 
ffnlrf '^'^/"io^^evaluation activities In essential. Local evaluation 
leaders must have the time and resources to monitor activities closely. 
This is the basis for the recommendation for school-released time for 
project personnel. 

It is recommended that local evaluation leaders establish clear-cut 
lines of communications among all those Involved in the effort. Inter- 
views site visits, phone calls, letters, and written reports should 
probably all be used in the monitoring effort. 
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APPENDIXES 



APPENDIX A 
PROJECT ORIENTATION LETTER 



II iro-M P.^^f ^° announce a project in which we believe you will 
v^!m ? "^"^'i in which we expect considerable dividenrior 
vocational education personnel at the local and State levels ?he 

ciwSnf sJ'J °^ °' ^« - issue of c;ncS: for 

ill T ' educators. We are pleased to announce the fad- 

ing of a pilot project of evaluating local and regional pub!" progr^ 
of^vocational education in the Central Vocational Region'of Ken't^ckyTor 

I^Mnf-nf c.'I^V'' administered through the Kentucky Research Coordi- 
TMctZi t f^rf" Evaluation Units for Vocational Education. The 
project directpr will be Dr. Floyd L. McKinney. Assistant Professor 

Snt'of Mfred'r'^S'^^^^^^ ^"'^ ^"^"-^ project directors 

Will be Dr. Alfred J. Mannebach, Assistant Professor, Kentucky Research 
Coordinating Unit, and C. 0. Neei. Coordinator of St^te ProgrL Evasion. 

"^A P"J^f ^«"Ph««i^es the use of local staff-citizens, students, faculty 
and administrators-with the assistance of State staff and outside 
consultants in determining local philosophy and objectives, developing and 
using appropriate evaluation procedures and techniques for assessing ?he 

rec^n^M K~"S °^ 'l!^ objectives, and in developing conclusions and 
recommendations based on the evaluation findings. 

We are hopeful that each public school system in the Central Kentucky 
Region will participate in this most important effort. Dr. McKinney 
Dr. Mannebach, or Mr. Neel will be in contact with you in the near 
future to schedule an appointment with you in your office so that they 
can further explain the project. They are also planning an orientation 
meeting for chief administrators and local project leaders on September 
10, 1970. We urge your attendance and cooperation. 

If you desire further information, please contact Dr. McKinney or 
Dr. Mannebach at the KRCU, 152 Taylor Education Building, University 
of Kentucky 40506 phone (502) 258-9000. Extension 2771, Station 335 

^* °* '^^^^v* ^"'^e*" °f Vocational Education, Frankfort, Kentucky 
40601 phone (502) 564-4426. 

We sincerely hope you look forward with great enthusiasm to participatina 
in this most worthwhile project. 

Very truly yours. 



Wendell P. Butler 

Superintendent of Public Instruction 



Carl F. Lamar 

Assistant Superintendent for Vocational Education 
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Orientation Meeting 
September 10, 1970 



Roster 



Ben Abraham 
John Adams, Jr. 
Charles Aebersold 
Andrew Bird 
Sandra Jo Bradley 
Mark Brovn 
Ray Brown 
Kenneth Carter 
Ribhard Cates 
Lorraine Darley 
Janes Disney 
Arsenio Espinoza 
Joe Gormley 
Steven Gyuro 
Stokley Hall 
Jack Hatfield 
A. T. Hensley 
Roberta Hill 
Victor Johnson 
Kenneth King 
Carl F. Lamar 
Joyce Logan 
Jack McElroy 
James McGown 
Douglas McKinley 



Fred Martin 
Leroy Martin 
W. C. Montgomery 
Elmer Moore 
Mary Elizabeth Moore 
Lester Mullins 
Eddie Murphy 
C. 0. Neel 
Dorotha Oatts 
Charles Oglesby 
Walden Penn 
Robert Pike 
Junior Poling 
Robert Prater 
Virginia Pratt 
Tom Radford 
Bronelle Skaggs 
Edward Thomas 
Mary Bell Vaughan 
Billy Vice 
Christine Wallace 
James West 
Howard Whitehead 
Jim Wilds 
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PROGRAM 

ORIENTATION MEETING 

CENTRAL KENTUCKY 
VOCATIONAL EDUCATION EVALUATION PROJECT 

Carnahan House 
University of Kentucky 
Lexington, Kentucky 

September 10, 1970 

9:30 a.m. Registration 

Coffee and Rolls 

10:00 a.m. Introductory Remarks • Floyd L. McKinney 

10:10 a.m. Welcome - Carl Lamar 

Importance and Need for Vocational Education Evaluation 

10:30 a.m. The Central Kentucky Vocational Education Evaluation Project 

- Floyd L. McKinney 

- Alfred J* Mannebach 

• C. 0. Neel 

12:00 noon Lunch at Carnahan House 

1:30 p.m. Roles, Relationships and Responsibilities of Participating 
Schools and the Bureau of Vocational Education 

• Floyd L. McKinney 

- Alfred J. Mannebach 

• C. 0. Neel 

2:30 p.m. Questions and Answers 
3:00 p.m. Adjourn 
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MEMORANDUM OF AGREEMENT 



The Kentucky Bureau of Vocational Education and the 



School District, City of 



t State of Kentucky agree 



in principle via this memorandum, rather than a legal contract, to 
conducting a research program in vocational education. 

The research activity to which this memorandum pertains is supported by ^ 
grant from the Kentucky Bureau of Vocational Education and by the local 



Both the Kentucky Bureau of Vocational Education and the 
School District agree to carry out the research effort beginning September, 
1970, and continuing at least through June, 1971. The personnel at the 
Kentucky Bureau of Vocational Education and at the 

School District recognize that each should be free to suggest modification 
of this research program at any time and that either may withdraw at any 
time. 

The responsibilities of the participants in this research endeavor are 
shown on the attachment. 

All research data and reports are confidential and the property of the 
Kentucky Bureau of Vocational Education until formally released by the 
Project Director in conformity with the regulations of the Kentucky 
Bureau of Vocational Education. 



school. 



/S/ 



/S/ 



Carl F. Lamar 
Assistant Superintendent 
Bureau of Vocational Education 
State Department of Education 
Frankfort, Kentucky 



Superintendent or authorized 
Representative 

School 

City 
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Local director of the project: 
Name 



Position 



Home Address 



School Address 


Street 


City 


Zip 


Phones: School 


Street 


City 


Zip 


Home 


(Area Code) 


(Number) 






(Area Code) 


(Number) 




Assistant director of the project: 






Name 








Position 


Home Address 


School Address 


Street 


City 


Zip 


Phones: School 


Street 


City 


Zip 


Home 


(Area Code) 


(Number) 






(Area Code) 


(Nucber) 





State Project Staff : 
Director: 



Floyd L. McKinney 
152 Taylor Education Building 
University of Kentucky 
Lexington, Kentucky A0506 
Phones: Office - 606-258-A9A6 
Home - 606-266-A177 



Assistant Directors: 



C. 0. Neel 

Bureau of Vocational Education 
State Department of Education 
Frankfort, Kentucky A0601B 
Phones: Office - 502-56A-AA26 
Home - 606-873-A862 

Alfred J. Mannebach 
152 Taylor Education Building 
University of Kentucky 
Lexington, Kentucky A0506 
Phones: Office - 606-285-56A0 
Home - 606-278*8238 
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OBJECTIVES WORKSHOP EVALUATION SCALE 
Please circle the number indicating your present position. 

1. Regional Evaluation Task Force 

2. Bureau of Vocational Education, Frankfort 

3. Instructional Materials Laboratory 

4. Research Coordinating Unit 

5. Other 

(Specify) ■ 

Part I - Directions: 

^^f/^jlJ.,"^*'*'^!!*' carefully and decide how jyou feel about It. You will 
agree with some statements and disagree with others. You are offered 
S^^^o^J i^^T" statement. The "undecided" answer should 

be circled only when you have no opinion. Circle one number following 
each statement. Please answer all statements . loiiowmg 

Example: Strongly Un- ois- Strongly 

TKo J ^ ^ , Agree Agree decided aeree DisaRree 

The city needs to improve garbage ~ ° ■ p*^^ ■ 

collection schedules 5 © 3 2 l 

This person feels in no uncertain terms that garbage collection schedules 
are inadequate. ov...cuu4.«=o 



Statements Strongly Un- Dis- Strongly 

1. The purposes of this workshop were ""^^ ^ ^ ^i^Sgree 



clear to me 



5 



2. The objectives of this workshop 
were not realistic 5 4 

3. Specific purposes made it easy to 
work efficiently 5 4 

A. The participants accepted the pur- 
poses of this workshop 5 4 

5, The objectives of this workshop were 

not the sane as my objectives ... 5 4 3 2 

6. I didn^t learn anything new .... 5 4 3 2 



3 
3 
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Statements 



?• The material presented was valuable 



Strongly Un- Dis- Strongly 

^A£ree_ Agree decided liaattSt 



to me 



* • • • • 



8. I could have learned as much by 

reading a book 5 ^ 

9* Possible solutions to my problems 

were considered 5 ^ 

10. The information presented was too 

elementary * . . 5 4 

11. The speakers really knew their 

subject 3 ^ 

12. The discussion leaders were not 

well prepared 5 ^ 

13. I was stimulated to think objec- 
tively about the topics presented . 5 4 

14. New acquaintances were made which 

will help in my future work .... 5 4 

15. We worked together as a group ... 5 4 

16. We did not relate theory to 

practice . 5 ^ 

17. The sessions followed a logical 

pattern 5 ^ 



4 3 2*1 

3 2 1 



1 
1 



3 2 1 

3 2 1 



3 2 1 



2 1 



1 



18. The schedule was too fixed .... 5 4 3 

19. The group discussions were excellent 5 4 3 2 

20. There was very little tii?« for 
informal conversation 5 4 3 2 1 

21. I did not have an opportunity to 
express my ideas \ ^ 5 4 3 2 1 

22. I really felt a part of this group 5 4 3 2 1 

23. My time was well spent 5 4 3 2 1 

24. The program met my expectations . . 5 4 3 2 1 

25. I have no guide for future action . 5 4 3 2 1 

26. Too much time was devoted to trivial 
Q matters 5 4 5 o 1 
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Statements Strongly Un- Dls- Strongly 

Agree Agree decided agree Disagree 

27. The Information presented was too 

advanced 5 4 3 2 

28. The content presented was not appli- 
cable to occupational programs . . 5 4 3 2 

29. Workshops of this nature should be 
offered again In future years ... 5 4 3 2 

30. Workshops such as this will contrib- 
ute little *^o my work 5 "4 3 2 

31. The research findings presented were 
useful to me In my job 5 4 3 2 

32. The references available to partici- 
pants were not appropriate .... 5 4 3 2 
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OONFEREKCE ON PERFORMANCE OBJECTIVES 



Central Kentucky 
Vocational Education Evaluation Project 



November 10, 1972 
Alumni House 
Kentucky State College 
Frankfort, Kentucky 



November 11, 1970 
Burrier Building 
Eastern Kentucky University 
Richmond, Kentucky 



CONFERENCE ON PERFORMANCE OBJECTIVES 
PROGRAM 

8:30 - 9:00 a.m. - Registration - Coffee 

Presiding - Floyd L. McKinney 

9:00 a.m.- Need and Importance of Performance 
Objectives - C. 0. Neel 



9:15 a.m.- Films trip and Tape - Introduction to Basic 
Principles 



9:45 a.m.- Filmstrip and Tape - General Goals, Affective 
and Cognitive Objectives 



10:15 a.m.- Small Group Meetings 



11:30 a.m.- Filmstrip and Tape - Main Components of an 
Objective: Behavioral Terms, Conditions , 
Standards 



12:00 Noon- Lunch 



1:00 p.m.- Writing Program Objectives 
- Alfred J. Mannebach 



1:30 p.m.- Small Group Meetings 
3:00 p.m.- Break 

3:15 p.m.- Instructional Objectives, Program Objectives 

and Evaluation Plan Objectives - Floyd L. McKinney 

3:30 p.m.- Adjourn 
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PROGRESS REVIEW MEETING 



Central Kentucky 
Vocational Education Evaluation Project 



9:30 a. m. 
March 9, 1971 



Central Kentucky 
Area Vocational School 

Vo-Tech Drive 

Lexington, Kentucky 
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PROGRESS REVIEW MEETING 



Presiding - Claude Howard 

9:30 a.m. • Welcome, Introduction of Guests 
- Group Discussions 



-Ohio Vocational Interest Survey - Kyle Ramey 
-Parental Survey - Alfred J. Mannebach 
-Manpower Studies. - C. 0. Neel and Claude Howard 
-Advisory Committees - Floyd L. McKinney 



10:30 a.m. - Group Meetings 
12:00 Noon - Lunch 

Presiding - Kyle Ramey 

1:00 p.m. - Reports from Group Meetings 

-Clayton P. Omvig 
-Christine Wallace 
-William Rearden 

1:20 p.m. - Analyzing and Interpreting Data 

-C. 0. Neel 
-Kyle Ramey 
-Alfred J. Mannebach 
-Floyd L. McKinney 

2:20 p.m. - Comments and Observations 

-John Coster 

2:40 p.m. - Problems and Concerns 

Plans for the Future 

3:00 p.m. - Tour of Facilities (optional) 
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GROUP MEETING ASSIGNMENTS 

Progress Review Meeting 
March 9, 1971 



GROUP A 

Group Leader - Claude Howard 
Resource Person - C. 0. Neel 
Reporter - Clayton P. Omvlg 

Anderson County Schools 
Frankfort Independent Schools 
Franklin County Extension Center 
Jessamine County Schools 
Scott County Schools 
Woodford County Schools 



GROUP B 

Group Leader - Kyle Ramey 

Resource Person - Floyd L. McKinney 

Reporter - William Bearden 

Bourbon County Schools 
Central Kentucky Area 
Vocational School 
Clark County Extension Center 
Fayette County Extension Center 
Fayette County Schools 
Harrison County Extension Center 



GROUP C 

Group Leader - Arthur Corns 

Resource Person - Alfred J. Mannebach 

Reporter - Christine Wallace 

Danville School of Nursing 
Garrard County Extension Center 
Harrodsburg Extension Center . 
Lincoln County Schools 
Madison County Extension Center 
Mercer County Schools 



I 
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Central Kentucky 
Vocational Education Evaluation Project 



CX)NSULTANT ASSIGNMENTS 



Floyd L. McKinney 

Central Kentucky Area Vocational School 
Fayette County Extension Center 
Fayette County Public Schools 
Jessamine County Public Schools 
Scott County Public Schools 
Woodford County Public Schools 



All red J. Mannebach 

Danville School of Practical Nursing 
Bourbon County Public Schools 
Clark County Extension Center 
Garrard County Extension Center 
Harrison County Extension Center 
Lincoln County Public Schools 
Madison County Extension Center 



C> 0. Neel 

Anderson County Public Schools 
Frankfort Independent Schools 
Franklin County Extension Center 
liarrodshurj^ Extension Center 
:.i(-rcer r\)inn\ Public Schools 
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FOLLOW-UP OF FORMER STUDENTS 
WE NEED YOUR HELP 



DIRECTIONS: Please read each question careful! v c.i . u 

answer and place an "X" type^ TeTr^^TlflL sp e%\ ^Le^^lLase 
do not omit any questions. Check only one answer for'e'S qJ^stLn 

1. How many full time jobs have you had since leaving school? 

1. None 

2. One 

3. Two 

4. Three 

5 . Four 

6. Five or more 

2. Title of your first full-time job: 



3. After leaving school, were you able to obtain full-time employment 
as soon as you expected? empioymenc 

L. 1- Yes 
2. No 

ame^^ob?^^'^'' ^^^''^"^ "^'^'^^ '^^^ "^'^^ ^ full. 



— 1. Began prior to leaving school 

2, Less than one week 

3. One to two weeks 

4* Three to four weeks 

5. Five to eight weeks 

6* Nine to sixteen weeks 

7. Seventeen to twenty-four weeks 

8» More than twenty-four weeks 

9. No full-time job 



If It took longer than you expected to find a full-time job, which 
one of the following reasons best describes what you think was the 
most Important reason? 

Found a full-time job as soon as I expected 
No jobs available In the community 
Wasn't Interested in the jobs available 
Parents wanted me to stay at home 

Lacked skills or other qualifications for the jobs available 
Was too young 
Got married 
Went to college 

Other (specify) 

In taking your first full-time job, which one of the following was 
most important to you? 

Earning money to go to school 
Working conditions 
Job Security 
Importance of work 
Opportunity for promotion 
Personal Interest 
S.-jlary 

Have never held a full-time job 

Other (specify) 



Do you have a disability or health condition that limits your 
employabillty? 

1. Yes 

2. No 

How many miles from your parent's home was the location of your first 
full-time job? 

0-50 miles 
51-100 miles 
101-150 miles 
151-200 miles 
201-250 miles 
251 miles or more 

How well did your education prepare you for your first job? 

Exceptionally well-prepared 
On the whole, well-prepared 
On the whole, not too well-prepared 
Very poorly prepared 





1- 
3- 

6. 
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10. If your first full-time Job was not in the area you studied in school, 
why was it not in that area? -cuowx. 



1. Tried, but couldn't find a Job 

2. Couldn't get into apprentice program 

3. Better type Job came along first 
A. Didn't want that type of work 

5. Instructor advised against it 

6. Other reason: (Explain) 



11. If you left your first full-tine Job. what vas the main reason for 
your leaving the Job? 

1* 1 «n still employed in first full-tine job 

2. Uid off (lack of work) 

3. Laid off (other reason) 

Quit (wanted more money) 

5. Quit (disliked type of work) 

6. Quit (disliked work conditions) 

7. Quit (no future in it) 

8. Quit (no other reason) 

9. To get married 

12. What was your starting pay (before deductions) on your first full-time 
Job after leaving school? 

1. Under $50 per week 

2. $5l-$75 per week 

3. $76-$100 per week 

A. $101-$125 per week 

5. $126 and over per week 

13. What is your present Job title: 



14. What is your pay (before deductions) on your present Job? 

Under $50 per week 
$51-75 per week 
$76-$100 per week 
$101-$125 per week 
$126-$150 per week 
$151-$175 per week 
$176 and over per week 

15. Considering all of your occupational experience since leaving school, 
how well do you feel your school prepared you? 

1. Well prepared 

2. Satisfactorily prepared 
3. Inadequately prepared 



1. 
2. 
3. 
4. 
5. 
6. 
7. 
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16. To what extent did the school prepare you to work with your supervisors, 
co-workers, and subordinates? 

!• Excellent preparation 

2. Adequate preparation 

3. Some preparation 

4. Little preparation 

5. No preparation 

Please rate your former school frankly on items 17 through 25* 



17. Quality of vocational 
instruction 

18. Quality of academic 
instruction 

19. Physical condition of 
school 

20. Physical condition of 
shops /labs 

21. Teacher interest in 
students 

22* Student guidance/ 
counseling 

23. Job placement of 
former students 

24. Availability of voca-- 
tional programs 

25* Information about Job 
opportunities 



ccellent 




u 

- * 


M 

0 




O 

o 
□ 2 


□ 3 


s 

D" 


□i 


□ 2 


□ 3 




□i 


□ 2 


□ 3 




□i 




□ 3 






□ 2 


□ 3 




□ x 


□ 2 


□ 3 




□l 


□ 2 


□ 3 




□ l 


□ 2 


□ 3 




□l 


□ 2 


□ 3 





JLrsch'oT"^^^^^ ^ following areas had been available in 
yoar school, which one do you now think you should have taken? 



1. Agricultural Occupations 

2. Business/Office Occupations 

3. Distributive Occupations 

4. Health Occupations 

5. Home Economics Occupations 

6. Technical/Technician Occupations 

7. Trade/Industrial Occupations 

8. Other (Please Specify) 



How well do you like your present job? 
1. Like 

2. Neither like nor dislike 

3. Dislike 

How long do you plan to stay in your present type of work? 

1 plan to make it a career 

— 2. Presently, I have no plans to change 
3. Probably a few years 

4* I want to change soon 

How much of the time are you satisfied with your job? 

1* Most of the time 

2. A good deal of the time 

3. About half of the time 

4 . Occasionally 

5. Seldom 

How do you feel about changing your job? 

— 1. I would quit this job if I had anything else to do. 

— 2. 1 would take almost any other job in which I could earn as 

much as I am earning here. 

— 3. This job is as good as the average, and I would just as soon 

have it as any other for the same money* 
^4. I am not eager to change jobs but would do so if I could make 
more money* 

— 5. I do not rant to change jobs even for money because this is 

a good one. 
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31. 



schoo? ^tlLTr^ '1?^ comunity where you lived when you left 

school, about how long after you left school did you move? 



1. Have not moved 

2. Within one month 

3. Two to six months 

4. Seven to twelve months 

5. More than twelve months 



32. 



^Ja'^a'"''''^^ ^1?^ community where you lived whan you left school 

why did you move? (Check the major reason) sctiool. 



1. Have not moved 

2. To take a job 

3. To seek a job 

4. Parents moved 

5. Got married 

6. Military service 

7. Go to school 



1. None 

2. 1320 hours 

3. 2640 hours 

Other (please specify) 

34. What is the highest year of college you completed? 

1. None 

2. 1 Year 

3. 2 Years 

4. 3 Years 

5. 4 Years 

6. 5 Years 

7. 6 Years 

schoolf university, or schools have you attended since leaving 



1. None 

If none, please go to question No. 38. 

2. Community college or Junior college 

3» Four-year college or university 

4. Military services 

— 5. Trade or business school (public and private) 

6. Adult classes 

7. Area vocational schools 

8» Company course or school 

9. Other (please specify) 
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If, since leaving schocA, you have attended or are now enrolled at a 
school, please check your field of study. 

!• Agricultural Occupations 

2. Business/Office Occupations 

3* Distributive Occupations 

^- Health Occupations 

5. Home Economics Occupations 

6- Technical/Technician Occupations 

7. Trade /Iitdus trial Occupations 

8. Other (please specify) 

What was (is) your specific course 6f study? 



Did you Successfully complete the program you checked in the last 
question? 



question? 

1. Yes 

2. No 



In what area would you be interested in obtaining more occupational 
education? 



1 . Agr 1 cultural Occupat ions 

2. Business/Of flce^ccupat ions 

3. Distributive Occupations 

4. Health Occupations 

5. Home Economics Occupations 

6. Technical/Technician 0<^cupations 

7. Trade/Industrial Occupations 

8. None 

9. Other (please specify) 



I am 



1. Single 

2. Married 

3. Other 



THANK YOU FOR HELP 



APPEl^DIX J 



FOLLOW-UP OF FORMER 
HOE ECONOMICS STUDENTS 



/ 



FOLLCW-UP OF FORMER 
HOME ECONOMICS STUDENTS 



1. How oany years of Hooe Economics did you complete In high school? 



1. less than 1 year 

2. one 

3. two 

4. three 
5 • four 



'''''^^^^^^ ^""^ ^^^^ <>f home economics in high school, 

!• dropped out of school 

2. only 1 year required 

3. disliked home economics 

: did not have time in schedule 

5. got a job 

3. How well did your home economics classes prepare you for your role 
as homemaker? 

!• exceptionally well* prepared 

2. on the whole, well-prepared 

3. on the whole, not too well-prepared 

^* very poorly prepared 

4. Have you held a full-tine job outside the home as well as being a 
homemaker? 

1. Yes 

2. No 

5. Have you held a part-time job outside the home as well ae being a 
homemaker? 

1. Yes 

2. No 

6. What is your reason for working outside the home? 

1* additional income 

2. bored at home 

3. enjoy working 
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7. If you do not have a full-time job outside the home what are the 
reasons? Check all that apply. 

1. I am married and do not want a job 

— 2t My husband does not vant me to take a job 

3, I have not been able to get a job 

^- I do not have job skills 

5. I have not tried to get a job 

6. I have small children at home 

8. How well did your home economics classes prepare you for a dual role 
ef homemaker-wage earner? 

1. well-prepared 

2. satisfactorily prepared 

3. inadequately prepared 

9. If you are employed outside the home, r^at do you do? 

1. secretary 

2. sales clerk 

3. cashier „^ 

^. If other specify: - 



10, 



VV.at are your major hon^making problems, if working outside the home? 

!• managing ime S 

2. care of children 

3. managing income 

^. help with housework 

5. husband objects 

6. making decisions 

7. tired 



home? 




1. 


managing time 


2. 


care of children 


3. 


managing income 


4. 


help with housework 


5. 


husband objects 


6. 


making decisions 


7. 


tired 
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ih'iL°"yoTw:S^^' ^^<^ for your children 



. !• no children 

^ 2. relatives 

_ 3. employed help in the home 

^- neighbor 

5. husband 

— 6. Child Care Center Worker 



ILZ^' are your children „hlle 



!• no children 

2. own home 

— 3. home of person providing care 

^- Day Care Center 

5. Nursery School 

6- Kindergarten 



ll/2"nToTlV]Z^'^- ""^ "-ledge 



1. Yes 

2. No^- 



15, 



Specify skills used: 

What additional helps do you wish you had received in hiah schnm 
home economics classes? ^^^^-vea xn aign school 

!• food for family 

— 2. mpxtaglvg time, energy, monev 
3* care of children 

— 4* home furnishings and equipment 
5. laundering 

6. others specify: 



related Job, which course do you think you would have taken? 

~ 2 Chnd'cIL'^r -/''^^''^f^' cook, food sup^r^l^sor) :^ 

~ 3 li.Mn c : (nursery school or day care aide) 

— r „'^°'^^"! Services - (seamstress, alterationist) 

- S^) "^""^""^'y S^'^i"^ - (housekeeping aide, hotel-motel 

_ 5. Home^ Furnishings Services - (drapery maker, decorator assi.- 



1 
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17. Has your study of home economics hau an effect upon your relationships 
with your parents, husband, brothers, sisters, children, friends? 

1. Yes, a lot 

2. Yes, some 

3. No \ 

18. Has your study of home economics helped you make satisfying 
decisions? 

1. most of the time 

2. some of the time 

3. no 

19. Please rate the Home Economics program on the following items. 

a 

01 
rH 
rH 

01 M M 

O O H O 

K O « O 

» O (z« P4 

department equipment for teaching 
all phases of HE 

department appearance 

teacher interest in students 

instruction based on student needs * 

students participate in planning 

up-to-date class instruction 

class activities were ir4teresting 

20. To wiiat extent did you have an opportunity to develop knowledge and 
skill in the home economics areas in your parents* home? 



Much Some Little 



managing a home 

caring for the home 

feeding the family 

caring for children 

clothing the family 

caring for Illness in family 

managing the income 



21. 



If marr^ id, when did you marry? 



!• below age 16 

2. during high school 

3» f±rst year after leaving school 

22. If married, how many children do you have? 

l'» none 

2. expecting 

3 . one 

4. two 

23. Where do you live? 



1. on farm 

2. in rural area 

3. in city 

^» if other than Kentucky, give state: 

24. What type of residence do you live in? 
Room 

Apartment 
House (rented) 
House (owned) 
House (buying) 
Mobile home 
With relatives 

25. What is your family annual income level? 

less than $3,000 
$3,000-$6,000 
$6,000-$10,000 
over $10,000 

. Have you been enrolled in adult Iiomemaking classes since you left 
school? 



1. 
2. 
3. 
4. 
5. 
6. 
7. 



1. 
2. 
3. 
4. 



_^ 1. none 

2. one 

3. two or three 

. 4. more than three 

27. Were you a member of the Future Homemakers of America organization? 

1. No 

2. One year 

3. Two years 

^ 4. Three years I. 

5. Four years | 
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WHAT IS VEEP? 

! 

The Central Kentucky Vocational Education Evaluation 
Project (VEEP) Is a pilot program designed to assist local 
educators evaluate .secondary and post-secondary programs 
of vocational education. The project is' sponsored by the 
Kentucky State Department of Education, Bureau of Voca- 
tional- Education. The Central Kentucky Area Vocational 
School, eight vocational extension centers, and eight secon- 
dary school systems In the Central Kentucky Region are par- 
ticipating In the project. 

Dr. Floyd L. McKlnney, Assistant Professor, Kentucky 
Research Coordinating Unit for Vocational Education, College 
of Education, University of Kentucky, Is the director of the 
project. Dr. Alfred J. Mannebach, Assistant Professor, KRCU, 
College of Education, University of Kentucky, and C. 0. Neel, 
Coordinator of State Program Evaluation for Vocational Edu- 
cation, are th<? assistant project directors. 

«i 

The purpose of the pilot program Is to identify and 
try-out procedures and techniques of evaluation In local schools in the 
Central Kentucky Region. Evaluation activities proven successful in the pilot 
program will be Initiated In other regions of Kentucky In the future. The 
concept of vocational education evaluation being tested is: Can local edu- 
cators effectively evaluate local programs of vocational education after 
having received instruction In evaluation methods through Inservlce workshops 
and consultant assistance? 

" Two persons from each of the cooperating schools have been appointed 

by the chief school administrator as local project leaders. The local project 
leaders have been participating in Inservlce educational workshops and con- 
ferences to prepare to conduct evaluations in their local school systems. 
Staff committees composed of vocational educators, general educators, guidance 
counselors and administrative personnel will assist in conducting the eval- 
uations in the participating schools. Citizens advisory committees; for the 
evaluation project will be Involved to provide the viewpoint of parents, 
employers, and local citizens. The viewpoint of students v'ill also be con- 

i 
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sidered. The local project leaders are responsible for coordinating the evaiuallwi. 
activities and Providing leadership to the evaluation effort in their school 
system. 

The procedures and techniques for evaluating local programs of vocational 
education emphasized in VEEP are based upon the research conducted by Dr. Harold 
M. Byram, Professor of Education, Michigan State University, East Lansing. Under 
Dr. Byram's direction, three Michigan schools conducted local evaluations from 
1963-65 as pilot projects, ten Michigan schools participated in 1966-67 as demon- 
stration schools and twenty school systems in four states cooperated in the third 
project. 

The objectives of the Central Kentucky Vocational Education Evaluation 
Project are: 

1. To try-out and demonstrate an evaluation procedure to determine whethe<r 
or not the secondary and post-secondary programs of vocational education 
in Central Kentucky Region are fulfilling the stated objectives, 

2. To develop state and local leadership competencies needed to evaluate 
programs of vocational education. 

3. To identify new or improved procedures for assisting schools in con- 
ducting program evaluations. 

A.' To enable vocational education personnel in the local and regional 
schools to be more proficient in: 

a) , identifying community and individual needs, 

b) writing^-'a vocational education philosophy, 

c) writing instructional and program objectives in performance terms, 

d) identifying the essential elements of a product-oriented progran 

evaluation effort, 

e) writing a'--product oriented evaluation Plan for th.ir local and/or 
regional program of vocational education, 

f) G*"gani2ing and using a citizens advisory committee, 

g) developing and administering follow-up instruments according to 
successful pij'actices as evidenced by research, 

h) analyzing data and developing recommendations based upon the 
analysis of data, and 

i) using evaluation findings as a basis for program improvement and 
program planning. 



Evaluation Philosophy 
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There are two primary reasons to evaluate programs of vocational education* 
he first is to determine the degree to which" the p re-determined objectives of the 
)rogram are being attained* If everyone concerned accepts the objectives of the 
>rogram and the program is accomplishing its objectives, little or no change in the 
)rogram is needed. If, on the other hand, the program is not meeting its objectives 
.hree factors must be considered. A change in the program is essential, a reassess- 
ment of the objectives of the program must be made, or different data must be col- 
.ected. In any event, the outcomes of the program must be evaluated* 

A second reason to evaluate programs of vocational education is for program 
.mprovement and program planning. Without continuous evaluation, few changes in 
/ocational education programs will result and program improvement will not ensue. 
:n addition, program planning will not be on solid ground unless it is based upon 
:ontinuous, systematic evaluation. 

The evaluation philosophy being emphasized in the Central Kentucky Vocational 
education Evaluation Project includes several points of emphasis, many of which 
lave been found successful in the evaluation projects conducted by Dr. Harold M. 
^yram, Michigan State University. 

The first of these is the emphasis on local involvement . Importance is 
>laced on self-evaluation by local citizens, students, and local school professional 
)ersonnel concerned with the program rather than by outside experts. Local people 
-esponsible for and affected by vocational programs do make appraisals of these 
)rograms regardless of the information or lack of information they possess for 
laking such evaluations. VEEP focuses on the involvement of local people because 
:hey are the onss affected by the program and/or because they are the ones re- 
sponsible for implementing program changes. 

Tne second point of emphasis in VEEP is the importance of local objectives , 
[nstructional and program objectives will be formulated and/or revised by the local 
:ltizens, local school personnel, and students. Objectives will be stated so as to 
Indicate clearly what it is that the person completing the program is expected to be 
able to do. Emphasis will be on determining the extent to which the vocational 
education program objectives in the local schools are being attained. 

The third focal point in VEEP will be the concentration on product oriented 
evaluation. The emphasis on product oriented evaluation stresses effectiveness 
rather than standards of excellence. The competence or success of the output of the 
urogram is stressed as contrasted with many previous evaluations which emphasized 
process elements or ways and m^ans. Product oriented «valuation does not stress 
:omparisons between vocational program areas. The emphasis will be on the product's 
attainment of the behavior specified by the objectives. 

The fourth point of emphasis is that VEEP is vocational centered . The focus 
^ill be on the total vocational or occupational education program of the school. 
\li parts of the curriculum having vocational objectives will be considered. 
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In VEEP, the clinical approach to educational research will be utilized. 
Attention will be focused on local problems of evaluation and on local initiative 
and leadership in solving these problems. Local leaders will be provided 
assistance through inservice workshops 2nd specialized consultant services. 

Elements of this system of evaluation which have been found to be important 
include strong administrative commitment, competent faculty leadership, use of 
staff and citizen committees, provision of time for faculty and project leaders 
to perform evaluation tasks, and effective consultant services 



VEEP MEETING 

The Central Kentucky Vocational Education Evaluation Project was initiated 
September 10, 1970 at an orientation meeting held at the Camahan House, University 
of Kentucky, Lexington. The purpose of the meeting was to orient school admini- 
strators and members of the local leadership team to the philosophy and concept 
of local, self-initiated evaluation. Approximately one-hundred persons attended 
the meeting. 

The first phase of a workshop to prepare local project leaders to conduct 
the evaluations of vocational education programs in local school systems was held 
September 21-22, 1970 at the Holiday Inn-North, Lexington. The primary focus of 
the workshop was to help the participants understand why evaluation is needed, 
write objectives in performance terms, organize and use citizens advisory committees, 
develop and use follow-up instruments^ and write an evaluation plan. Workshop 
consultants included Mr. Jerry Butts, Director, Vocational Education, Coruana 
Public Schools, Corunna-, Michigan; Dr. "Harold M. Byram, Professor of Education, 
Michigan State University, East Lansing; Dr. Carl F. Lamar, Assistant Superinten- 
dent, Bureau of Vocational Education, Kentucky State Department of Education, 
Frankfort; and Dr. Gene Love, Associate Professor of Education, University of 
Missouri) Columbia. 

The second phase of the workshop was conducted October 26-27, 1970 at .the 
Camahan House, University of Kentucky, Lexington. The purpose of the two day 
workshop was to review the progress of the participating schools to date and to 
prepare the participants to use data processing, interpret evaluation findings, 
schedule evaluation activities and implement evaluation results. Consultants 
for the workshop included Dr. Carl F. Lamar; Dr. William Hull, Research Specialist, 
The Center for Vocational and Technical Education, The Ohio State University, 
Columbus; and Dr. Clayton P. Omvig and Dr. Steven J. Gyuro, Assistant Professors, 
Kentucky Research Coordinating Unit for Vocational Education, College of Education, 
University of Kentucky, Lexington. 

A conference on developing performance objectives and progress review 
meetings are scheduled as an integral part of the project. 
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ACTIVITIES OF PARTICIPATING SCHOOLS 

organized, the staff coamittee. the citizens advisory, committee on 
evaluation, and students will assist in writing a local evaluaWbn X Y^e 
major elements of the plan will include a description of the l6cS pr^;^™ of 
vocational education, the objectives of the evaluation effort. t£ rSpo^i! 
bilities and duties of the various committees and the evaluation act ivJwes to 
be accomplished. The plans will serve as guidelines for c^ducting evS^^tion 
activities in the participating local school systems. evaluation 

EDUCATIONAL INSTITUTIONS 
PARTICIPATING IN VEEP 

n«r^^r^II!^^°^^^^"! educational institutions in the Central Kentucky area are 
participating m the evaluation project. The local project director and the 
assistant project director are listed for each instiLtion. ^ 

Anderson County Public Schools 
Bill W. Rideout and Vernon Sutton 

Central Kentucky Area Vocational School 
Arthur L. Morgan and Erric Shaffer 

Clark Co unty Vocational Education Extension Center 
Dover Comet t and William C. Berry ' 

Danville School of Practical Nursinf^ 
Moseill B.' Jester and Virginia Towles 

Fayette County Public Schools 
Eddie Murphy 

Fayette County Vocational Education Extension Center 
Kenneth Blair and Harold Taylor ' 

Frankfort Independent Schools 
Alice Samuels and Jim Smith 

Franklin County Vocational Education Extension Center 
John A. Stallard and Blane Hawkins ' 

Bourbon County Public Schools 

George Stewart and Clara^cCracken 
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Garrard County Vocational Education Extension Center 
Gabriel U. Gabriel and Charles Thomas 

Harrison County Vocational Education Extension Center 
William Lockhart and James Plummer 

Harrodsburg Vocational Education Extension Center 
John C. Thomas and Lawrence Hendren 

Jessamine County Public Schools 
Portia House and Ann Daugherty 

Lincoln County Public Schools 
Ralph Estes and Darrell Story 

Madison County Vocational Education Extension Center 
Donald Vurpin and Lowell Brandenburg 

Mercer County Publxc Schools 

Walter Rowe and Howard E* Whitehead 

Scott County Public Schools 

Tom Radford and Victor F. Johnson 

Woodford County Public Schools 

James C. Wild and Willie Lee Caywood 

CONFERENCE ON OBJECTIVES 



Two-one day conferences on writing performance objectives will be held for 
the local leadership team and as many other local staff members as schools would 
like to have in attendance. These conferences are considered extremely important 
to the success of the evaluation effort. It is impossible to effectively evaluate 
the contribution of an educational program if the objectives of that program are 
not stated in measurable terms. It is hoped that at the end of the conference 
the participants will be more nearly able to write objectives which identify the 
behavior students should possess after having been in an educational program, the 
conditions under which the behavior is to occur, and the criteria of acceptable 
performance. 

• 

The conferences are scheduled for November 10 and November 11. The 
November 10 meeting will be for those persons associated with vocational education 
extension centers, the Central Kentucky Vocational School and the State Evaluation 
Task Force. The November 10 meeting will be held in the Alumni House, Kentucky 
State College, Frankfort. 

The November 11 meeting will be for those persons from county public 
schools, independent school districts and the Regional Evaluation Task Force. 
The November 11 meeting will be held in the Burrier Building, Eastern Kentucky 
University, Richmond. 

Both meetings will begin at 9:00 a.m. and adjourn at 3:00 r.m. 



PROGRESS REVIEW MEETING 
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^« P ^! first VEEP progress review meeting will be held November 20, 1970 
in Patterson Office Towers Building on the 18th. Floor. The meeting will 
begin with coffee at 9:00 a.m. and will adjourn at 3:00 p.m. 

purposes of the progress review meeting are to share Ideas, J 
problems and successes and to gain additional Information on evaluation '—^ 
procedures and techniques from consultants, VEEP staff members and fellow ' 
local project leadership team members. 

Local Project leadership team members should be prepared to present 
a report on the status of their evaluation effort. Materials, relating to 
the evaluation program, produced at the local school should be distributed 
to fellow local leadership team members if it is thought they would be 
applicable In other educational Institutions. 

VEEP CALENDAR OF EVEfJTS 



November 10 



November 11 



November 20 
December 1-9 



Conference on Developfng Performance 
Objectives. Extension Centers. State 
Evaluation Task Force.. Kentucky State 
College, Alumni House. 9:00 a.m. to 3:00 p.m. 

Conference on Developing Performance 
Objectives. County and Independent 
Schools. Regional Evaluation Task Force. 
Eastern Kentucky University, Burrier 
Building. 9:00 a.m. to 3:00 p.m. 

Progress Review Meeting. 

American Vocational Association 
Convention, New Orleans. 



December 31 



Local Project Quarterly Report Due. 
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SUGGESTIONS FOR CONDUCTING A FCLLCW-UP STUDY 




CENTRAL KENTUCKY 



VOCATIONAL EDUCA'JION EVALUATION PROJECT 

THE MAILING PROCEDURES* 

Suggestions for Conducting a Follow-up Study 

YOUR GOAL SHOULD BE RESPONSES 
FROM ALL OF THE FORMER STUDENTS IN 
YOUR TARGET CIJ^SSES 



. Select the target classes. (We have used the 1963 class.) 



3. Use former student social security number or assign a code number 
to each former student* 

4. Type cover letter for first mailing/ 

5. Prepare envelopes for first mailing: envelopes addressed to fomer 
students and stamped return-envelopes addressed to the school. 

6* Write social security numbers on questionnaires and be very careful 
to stuff the questionnaire into the envelopes so that the social 
security number on the questionnaire is the number assigned to the 
student to whom the envelope is addressed^ 

7. Prepare first "thank you reminder cards" for mailing. 

8» Make first mailing. The following pattern is suggested at 
one week intervals 

1st mailing - Quescionnaire, cover letter, and return 

envelope stamped and addressed. 
2nd mailing - First Thank You Reminder Card. 
3rd mailing - Second Request Questionnaire, 2nd cover 

letter, and return envelope (stamped 

and addressed) . 
4th mailing - Second Thank You Reminder Card 



2. 



Compile a complete list of former students. 



current addresses. 



*Adapted from original material developed by Dr* 0. Donald Meaders, 
Michigan State University 
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10. 



Note: Plan the mailing so as to avoid a holiday season. 
For example : 

Do Do Don't 

1st mailing Nov, 2 Jan. 7 Dec, 6 

2nd mailing Nov, 9 Jan. 14 Dec, 13 

3rd mailing Nov, 16 Jan, 21 Dec. 20 

4th mailing Nov. 23 Jan, 28 Dec. 27 

■If s'ome of the envelopeT'lnnthe mailing are returned 

ADDRESS UNKNOTO, it is very important to make every possible 
effort to locate the current address of the former student. 
Ask former students, relatives, classmate's — anyone who may 
. give you the current address, IT IS ESSENTIAL TO HAVE 
RESPONSES FROM 75% OR MORE OF THE GRADUATES. 

^^en the responses are received, carefully check the response 
against your master list. of names and addresses. Indicate 
by some mark which former students have responded. 

11. After one week, mail the first thank you reminder card to all 
of the persons on the original list, except those for whom 

no addresses have been located, 

12. The second request mailing is made only to those former students 
who have not responded two weeks after the first mailing. 

.The questionnaires are coded exactly the same as for the first 
'Val^li.ig and IN ADDITION, use a red pencil to write ^'Second 
request'* in the upper right hand corner of the £ront side 
of the questionnaire," Be sure to fold the questionnaire so 
this notation is on the outside fold. Be sure to use the second 
request cover letter* 

13. One week later, send the second Thank-You Reminder card to 
all persons who were on the second request questionnarie 
mailing, 

14. Be neat, orderly, systematic, patient and persistent,. 
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SAMPLE 



First Mailing — Cover Letter 
(School Letterhead) 



Date 



Dear ; 

We are pleased to have an opportunity to contact you regarding your 
employment since leaving our high school. We are coopefating^i^h 
vnl.fi ? ^" ^^^^ ^"^ "^"^ '^^^ Kentucky Bureau of 

Iducltion? '° ^'^^ "^^'Js f« vocational and technical 

Your responses on ti;e enclosed questionnaire will help school staff 
members make a realistic review of what former students are now 
doing and what kinds of traxnir.g programs might be desired.' It is 
not necessary for you to sign your name to the questionnaire since 
it has been pre-coded for objectivity during analysis. 

Please use the enclosed envelope to return the questionnaire 
immediately. Your cooperation is greatly appreciated. 

Sincerely, 



Superintendent of Schools or Vocational Teacher 



SAMPLE 

Second Mailing— First Thank You Reminder Card 

March 31, 1965 

We want to express our thanks for your cooperation in 
completing the questionnaire recently sent to you. We 
hope to have some summaries made early in April. 

Sincerely, 



Superintendent of Schools or 
Vocational Teacher 

-P. S. If you have not yet completed the questionnaire, 
plea:!e complete it and put it in the mail today. 
Thanks , 
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SAMPLE 



Third Mailing — Second Request Cover Letter - 
(School Letterhead) 
Date ^ 



Dear : 

The response to our request for information from members of the 1963 
class has been most gratifying. The return questionnaires are 
being analyzed by school staff members and we hope ta present a 
preliminary report within the next three weeks. 

Perhaps the first questionnaire we sent to you has-^been mislaid and 
so we have enclosed another for your convenience. We hope to have 
all of our former students respond so that the information will be 
as complete as possible* 

Please use the enclosed envelope to return the completed questionnaire 
today. Thanks for your cooperation, f 

Sincerely, 



Superintendent of Schools 



SAMPLE 

Fourth Mailing ~ Second Thank You Reminder Card 

April lA, 1965 

Your cooperation is appreciated. The completed 
questionnaires have provided the school staff with 
much valuable information for developing a plan 
to meet the vocational and technical education 
needs of youth in our area. - " 

Sincerely, 



Superintendent of Schools 

P. S. Perhaps your quest ionnarie is one of the few still 
not received. We hope it is now in the mail. * 
Thanks. 
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EMPLOYERS' '{lUESTIONNAI RE 
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EMPLOYERS' QUESTIONHAIRE 



1. How many people do you employ? 

2. Of your employees, hot7 many were living in the state of Kentucky 
When they were hired? 



3* How many of your f aployees received vocational educat ion? 

4* Of your employees who received vocational education how many were 
educated in Kentucky? 



5* How do your eiq>loyees who received vocational education compare with 
the employees who did not receive vocational education? (This calls 
for a reasonable judgment on your part.) 

5.1 Vocational education graduates needed no on-the-job 

training. 

5.2 Vocational education graduates needed less on-the-job 

training than non-graduates. 
— 5.3 Vocational education graduates and non-graduates are about 

the same. 

5.4 Vocational education graduates need more on-the-job 

training. 

6. Of your employees, who account for more •'output". (Sales, production, 
etc.) 

_^ 6.1 Vocational education graduates 
^ 6 .2 Non-graduates 

?• Is your company/business fully manned? 

7.1 Yes (Skip to question 9) 

7.2 No 

8* In what field do you have difficulty in obtaining employees? 

8.1 Trade or Industrial Occupations 

, 8.2 Distributive Occupations 

_ 8.3 Health Occupations 

8.4 Agricultural Occupations 

8.5 Technical /Technician Occupations 

; 8.6 Office/Businesf Occupations r 

8.7 Other (Specify) ' 
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9. Do you encourage your employees to continue their education? 

_ 9.1 Yes 
9.2 No 

10. Is there any incentive (such as promotion or Increased salary) for 
continuing education? 

10.1 Yes 

10.2 No 

11. What courses or programs of vocational education would ^ou like to 
see introduced or improved in the Kentucky Vocational Education 

S *stem? Explain 



12 • VJhat courses would you like to see introc^uced into the Kentucky 
Vocational Education System? 



13. Do you have any type of program aimed at employment of the culturally 
disadvantaged? (Such as supplementary training programs, recruiting 
employees from disadvantaged areas, etc.) 

_ 13.1 Yes 
13.2 No 

(If Yes, please explain briefly) 



In comparison with your other employees, how would you tate your employees 
who received vocational^tralnlng? (Questions 14 through 20) 

14. In fires t in his (or her) work? 



14.1 


Superior 


14.2 


Above Average 


14.3 


Average 


14.4 


Below Average 


_ 14.5 


Definitely Inferior 


Eagerness 


to learn more about the job. 


15.1 


Superior 


15.2 


Above Average 


15.3 


Average 


15.4 


Below Average 


15. 5 


Definitely Inferior 



t 



127 



16. Willingness to assume responsibility. 

16.1 Superior 

16.2 Above Average 

_^ 16^3 Average 

16.4 Below Average 

16.5 Definitely Inferior 

17. Leadership Ability 

17.1 Superior 

17. '2 Above Average 

17.3 Average 

17.4 ^Beloir"Average 

17.5 Definitely Inferior 

18. Attitude toward and cooperation with others. 

18.1 Superior 

18.2 Above Average 

, 18.3 Average 

18.4 Below Average 

18.5 Definitely Inferior 

19. Attitude toward his/her job. 

19.1 Superior 

19.2 Above Average 

19.3 Average 

19.4 Below Average 

19.5 Definitely Inferior 

20. Regularity of attendance at work 4 

20.1 Superior 

20.2 Above Average-- 

20.3 Average 

20.4 Below Average 

20.5 Definitely Inferior 




